-- Logs begin at Wed 2022-08-17 22:25:43 UTC, end at Wed 2022-08-17 23:42:59 UTC. -- Aug 17 23:12:34.880805 dv-cinder-820027-20-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 17 23:12:34.888134 dv-cinder-820027-20-smb devstack@keystone.service[85562]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 23:12:34 2022] *** Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: nodename: dv-cinder-820027-20-smb Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: machine: x86_64 Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: clock source: unix Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: pcre jit disabled Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: detected number of CPU cores: 4 Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: current working directory: / Aug 17 23:12:34.890274 dv-cinder-820027-20-smb devstack@keystone.service[85562]: detected binary path: /usr/bin/uwsgi-core Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: your processes number limit is 47680 Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: your memory page size is 4096 bytes Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: detected max file descriptor number: 2048 Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: lock engine: pthread robust mutexes Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: thunder lock: enabled Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 17 23:12:34.890865 dv-cinder-820027-20-smb devstack@keystone.service[85562]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 23:12:34.931200 dv-cinder-820027-20-smb devstack@keystone.service[85562]: Python main interpreter initialized at 0x556d057699c0 Aug 17 23:12:34.931200 dv-cinder-820027-20-smb devstack@keystone.service[85562]: python threads support enabled Aug 17 23:12:34.931200 dv-cinder-820027-20-smb devstack@keystone.service[85562]: your server socket listen backlog is limited to 100 connections Aug 17 23:12:34.931200 dv-cinder-820027-20-smb devstack@keystone.service[85562]: your mercy for graceful operations on workers is 90 seconds Aug 17 23:12:34.931642 dv-cinder-820027-20-smb devstack@keystone.service[85562]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 23:12:34.931642 dv-cinder-820027-20-smb devstack@keystone.service[85562]: *** Operational MODE: preforking *** Aug 17 23:12:34.931922 dv-cinder-820027-20-smb devstack@keystone.service[85562]: *** uWSGI is running in multiple interpreter mode *** Aug 17 23:12:34.931922 dv-cinder-820027-20-smb devstack@keystone.service[85562]: spawned uWSGI master process (pid: 85562) Aug 17 23:12:34.932123 dv-cinder-820027-20-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 17 23:12:34.934218 dv-cinder-820027-20-smb devstack@keystone.service[85562]: spawned uWSGI worker 1 (pid: 85576, cores: 1) Aug 17 23:12:34.934218 dv-cinder-820027-20-smb devstack@keystone.service[85562]: spawned uWSGI worker 2 (pid: 85577, cores: 1) Aug 17 23:12:34.934218 dv-cinder-820027-20-smb devstack@keystone.service[85562]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 23:12:39.264023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:12:39.264023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: from cryptography.utils import int_from_bytes Aug 17 23:12:39.264841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:12:39.264841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: from cryptography.utils import int_from_bytes Aug 17 23:12:39.266481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:12:39.266481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: from cryptography.utils import int_from_bytes Aug 17 23:12:39.266951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 23:12:39.266951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: from cryptography.utils import int_from_bytes Aug 17 23:12:39.316034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 23:12:39.316222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 23:12:39.316406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] command line args: [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 23:12:39.316675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 23:12:39.316854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ================================================================================ {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 23:12:39.317011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 23:12:39.317100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] admin_token = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.317208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 23:12:39.317344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] config_dir = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.317430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] command line args: [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 23:12:39.317532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.317663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 23:12:39.317748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] config_source = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.317843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ================================================================================ {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 23:12:39.317927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] debug = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.318062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.319508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] admin_token = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.319508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] config_dir = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.319720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.319796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.319919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] insecure_debug = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.319994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] config_source = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] debug = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] insecure_debug = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_config_append = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.320951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_dir = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_file = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_config_append = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_dir = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.321926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_file = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.322973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.323913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] notification_format = cadf {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] notification_format = cadf {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] publish_errors = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.324968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] publish_errors = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] standard_threads = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] strict_password_check = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.325986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] standard_threads = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] use_eventlog = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] strict_password_check = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] use_journal = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] use_json = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] use_eventlog = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] use_stderr = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.326972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] use_journal = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] use_syslog = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] use_json = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] watch_log_file = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] use_stderr = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.327532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] use_syslog = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.327783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] watch_log_file = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 23:12:39.327958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.328938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.329900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.330895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.331948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.332979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.333923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.334988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.335852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.336963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.337905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.338960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.339890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.340876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.341562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.341749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.341891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.341891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.342935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.343933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.344897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.345968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.enabled = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.enabled = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.346970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.347976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.348926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.349972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.350933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.351890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.352902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.external = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.mapped = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.external = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.mapped = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.353850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.password = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] auth.token = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.password = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] catalog.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] auth.token = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.354965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] catalog.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.355918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.356034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.356149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.356265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.356388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.356507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357856 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.357975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.358885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.359939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.360898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.361960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.362906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.363955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.364928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.365930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.366941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.367940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.368884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.369933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.370903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.371974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.password = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.372954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.password = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.373908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.374967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.375925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.376986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.377989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.378948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.379889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.380952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.381959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] policy.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.382943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] policy.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] receipt.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.383885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] receipt.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.384818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.385947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] revoke.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] revoke.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.386903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] role.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.387019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.387148 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] role.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.387266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.387382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] role.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.387533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] role.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.387649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] role.list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.388278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] role.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.388414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.388533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] role.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.388649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.388766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] role.list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.388882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.389952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.390940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.391881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.392924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.393990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.394954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.395895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.provider = fernet {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.396960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.provider = fernet {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.397932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] trust.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] trust.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.398899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.399954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.connection = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400682 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.400913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.connection = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.401991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402238 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.402978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.403209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.403326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.404959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85576) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 23:12:39.405729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 23:12:39.405729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=85577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 23:12:39.433170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.433305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.433403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.433528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.433613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.433762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.442400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.442935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.471276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.471504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.471954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.472190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.525336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.525891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.574493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.574755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.574911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.575146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.732060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.732291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.732516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.732763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.732947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.733147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.733288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.733521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.733750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.733969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.734187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.734403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.755961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.756954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.757037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.757164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.757246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.757372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.768583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.768776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.782282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.782458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.782680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.782925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.783992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.784205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=85576) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 17 23:12:39.800157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.800369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 23:12:39.800638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.800721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.800850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 23:12:39.800934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 23:12:39.801162 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.801245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.801380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 17 23:12:39.801462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.801653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.801912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.801994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.802172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.802422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.802682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.812098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.812380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.812655 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.812898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.812980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.813178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.813448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.813728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.819979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.820701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.822891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.823182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.823467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.823584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.823752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.823871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.824984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.825298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.825434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.825584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.825786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.825869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.826282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.826565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.826867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.849055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.850519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.850679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.850860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.852152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.852432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.856565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.856855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.857242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.857392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.857678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.857963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.863587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.863877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.864298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.864583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.867962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.868256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.868541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.868659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.868825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.868947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.869923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.870043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.870300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.870566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.887965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.888298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.889362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.889644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.892176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.893525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.895424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.895726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.896739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.897036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.899931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.901221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.903102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.905229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.907206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.907510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.907800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.908090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.908372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.908671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.908819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.909035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.909322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.909605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.909882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.910162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.924613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.924916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.925187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.925456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.926910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.927218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.927487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.927748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.932345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.933872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.934155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.935112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.937339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.937626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.937724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.937914 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.937998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.938221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.938506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.940585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.940872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.941155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.941453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.941744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.949794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.950084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.950490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.951030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.951331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.951620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.951909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.954640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.954960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.955243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.955525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.955808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.956126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.956426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.967885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.971018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.973910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.974884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.975382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.976844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.977130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.977428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.977887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.981233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.983751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.984713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.985227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.985511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.985811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.986170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.989138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.989442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.989733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.990022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.992270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.993720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.996691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.996993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.997455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.997834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.997984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:39.998283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:39.998569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.005448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=85577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:40.005737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.005834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:40.006023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.006107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.006300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.006383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.006575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.006877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.007154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.007432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.007714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.007985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.008274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.008628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.008822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.009092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=85577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.013440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=85576) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 17 23:12:40.013734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.014020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.014300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.014575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.014993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.015490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.015974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.016492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.016996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.017508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.017808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.018096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.018369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=85576) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 17 23:12:40.045007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d057699c0 pid: 85577 (default app) Aug 17 23:12:40.048465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ca36-01f3-451c-8c34-4cef68c426d5 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:40.048761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ca36-01f3-451c-8c34-4cef68c426d5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:40.049038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b14ca36-01f3-451c-8c34-4cef68c426d5 None None] PATH_INFO: `/v3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:40.053223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Wed Aug 17 23:12:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:40.054140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556d057699c0 pid: 85576 (default app) Aug 17 23:12:46.654478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:46.655040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:46.655040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:46.656608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 2/2] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:12:46.664109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:46.664723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:46.664998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:46.740581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: INFO dbcounter [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] Registered counter for database keystone Aug 17 23:12:46.759893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG oslo_db.sqlalchemy.engines [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85576) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:12:46.767103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writer thread running {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:12:46.948405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG passlib.handlers.bcrypt [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=85576) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 23:12:46.948740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG passlib.handlers.bcrypt [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=85576) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 23:12:47.003483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:47.005069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:47.137867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1/3] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 23:12:47.622225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:47.691862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: INFO dbcounter [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] Registered counter for database keystone Aug 17 23:12:47.714111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG oslo_db.sqlalchemy.engines [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 23:12:47.721036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writer thread running {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 23:12:47.839356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0504fff1-2505-4f15-ae28-8e0a00f6f26b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:47.844440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:47.845072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:47.845355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:47.845630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:47.853646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:47.904857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 23:12:47.905140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f155839-9dbe-45c8-833e-ad442068bbc6 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:47.914980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 3/4] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Aug 17 23:12:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:12:47.922498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:47.937452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce5416a-b06f-484d-a026-e6982812baf8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:47.941868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:47.943009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:47.943298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:47.943577 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] PATH_INFO: `/v3/projects/f53e7d1f09604616930e1b6b4872ea9e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:47.945150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] RBAC: Authorizing `identity:get_project(project_id=f53e7d1f09604616930e1b6b4872ea9e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:47.997555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 17 23:12:47.997898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e35a1b3-6cda-46e3-ab50-ebec86c39ab7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:48.003089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 2/5] 10.222.0.39 () {56 vars in 1207 bytes} [Wed Aug 17 23:12:47 2022] GET /identity/v3/projects/f53e7d1f09604616930e1b6b4872ea9e => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:12:49.892486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da800bd-a7c2-4515-9bce-43fe08fd09c7 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:49.893063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da800bd-a7c2-4515-9bce-43fe08fd09c7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:49.893063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da800bd-a7c2-4515-9bce-43fe08fd09c7 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:49.897207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 4/6] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:12:49.902641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:49.903074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:49.903223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:49.923423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:49.924944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:49.933868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 3/7] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:49 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 17 23:12:50.202610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da800bd-a7c2-4515-9bce-43fe08fd09c7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:50.214544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da800bd-a7c2-4515-9bce-43fe08fd09c7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:50.218880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b69ac0-694d-47c9-a379-895a7bcfea70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:50.219482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69ac0-694d-47c9-a379-895a7bcfea70 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:50.219765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69ac0-694d-47c9-a379-895a7bcfea70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:50.220039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b69ac0-694d-47c9-a379-895a7bcfea70 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:50.227570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b69ac0-694d-47c9-a379-895a7bcfea70 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:50.229350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b69ac0-694d-47c9-a379-895a7bcfea70 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:50.238645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 5/8] 10.222.0.39 () {58 vars in 1324 bytes} [Wed Aug 17 23:12:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 23:12:50.244176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:50.254151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625d3ed-ee67-48a9-98f7-c3e6e5f15b2e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:50.258442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4c5d6d-aea4-445f-b7e4-1d7f8e376436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:50.259104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5d6d-aea4-445f-b7e4-1d7f8e376436 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:50.259393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5d6d-aea4-445f-b7e4-1d7f8e376436 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:50.259671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4c5d6d-aea4-445f-b7e4-1d7f8e376436 admin admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:50.260973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5d6d-aea4-445f-b7e4-1d7f8e376436 admin admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:50.263006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4c5d6d-aea4-445f-b7e4-1d7f8e376436 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:50.264536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 4/9] 10.222.0.39 () {56 vars in 1198 bytes} [Wed Aug 17 23:12:50 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:52.235342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c323c3-8ff9-4a84-8557-5b0c96def6bb None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.235883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c323c3-8ff9-4a84-8557-5b0c96def6bb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.235883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c323c3-8ff9-4a84-8557-5b0c96def6bb None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.237230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 6/10] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:52.242359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.242797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.242955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.261163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:52.262578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:52.265095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b4af6-f215-4420-b6bb-9b6c5a9d4eae None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.265385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b4af6-f215-4420-b6bb-9b6c5a9d4eae None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.265660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b4af6-f215-4420-b6bb-9b6c5a9d4eae None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.267025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 7/11] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:12:52.272158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.272447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.272720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.315749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG passlib.handlers.bcrypt [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=85577) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 17 23:12:52.316179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG passlib.handlers.bcrypt [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=85577) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 17 23:12:52.343663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 5/12] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:12:52.361514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:52.363177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:52.460644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 8/13] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:12:52.610644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:52.635443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:52.723005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea275f-9e89-4be8-b18b-1be65f960dd0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:52.734842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:52.758024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:52.758663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.758974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.759247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.770843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:12:52.780367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:12:52.781394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:12:52.782213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 6/14] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:12:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:12:52.787200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:52.850765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64663c4a-2854-4527-b26f-9b2a9ac43cc4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:52.853039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:52.867844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:52.887297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5653c1e-62d9-4b85-bcea-658ab5ee46ab None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:52.890656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:52.891544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.891834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.892107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.924128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:52.924731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:52.925015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:52.925292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:52.925962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:12:52.926372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:52.927800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:52.939847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 7/15] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:12:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:12:52.945292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:52.959848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:52.961380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:53.044007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c14e02-d8f9-43a2-9a21-b78eb4845f11 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:53.058431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 9/16] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:12:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:12:53.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:53.066536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:53.081316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:53.082413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:53.082939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:53.083445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:53.085146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:53.086607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:53.088216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 8/17] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:12:52 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:12:53.095553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:53.110791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:53.165280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a0aa-9a27-4a1c-b4f7-c00ba25c4cbf None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:53.198534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:53.199972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad39ff0-58eb-4091-9756-24a93259dce9 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:53.200270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:53.200560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:53.200830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:53.219489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:53.220956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:53.233315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:53.233942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:53.234234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:53.234512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:53.235671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:53.237117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:12:53.238651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:12:53.240294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:12:53.241320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:12:53.241320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:12:53.241320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:12:53.241507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:12:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:12:53.241595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:12:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:12:53.244337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:53.247803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:53.305621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:53.332746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:53.349972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c295e8-4536-4470-85a0-712c444b269a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:53.353040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60086c00-1e23-496c-b121-9ae8641f3152 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:53.383901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:53.384586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:53.384861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:53.385133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:53.386144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:12:53.387335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:53.388939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4491411a-f2a7-448d-95d6-8b736303cbac None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:53.389150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:53.390222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:53.390760 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:53.391055 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:53.391802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.domain.id=default, user.id=d38ffb577def40dfa87abed73eb72b3e) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:12:53.392116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:53.393544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f5fd71-5c04-421d-baa2-a92f22f12c68 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:53.400486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Aug 17 23:12:53 2022] GET /identity/v3/role_assignments?user.id=d38ffb577def40dfa87abed73eb72b3e&scope.domain.id=default&role.id=585c0d47a790421289bad938a0377b4f => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:53.409453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:12:55.399167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61f98-c7f0-434b-916b-6f3940f3809b None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:55.400202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61f98-c7f0-434b-916b-6f3940f3809b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:55.400685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e61f98-c7f0-434b-916b-6f3940f3809b None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:55.402524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:55.408420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0f82-fbba-467e-b143-860d8d4867de None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:55.408850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0f82-fbba-467e-b143-860d8d4867de None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:55.409025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f0f82-fbba-467e-b143-860d8d4867de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:55.435929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-244f0f82-fbba-467e-b143-860d8d4867de None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:55.437142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-244f0f82-fbba-467e-b143-860d8d4867de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:55.524044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:12:55.576003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b3cc-f45a-425a-8415-088085a2acb8 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:55.576349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b3cc-f45a-425a-8415-088085a2acb8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:55.576576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081b3cc-f45a-425a-8415-088085a2acb8 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:55.578075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:55.583505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568c2c-90a1-467a-81d3-66cb6f0dc1e3 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:55.583804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568c2c-90a1-467a-81d3-66cb6f0dc1e3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:55.584089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15568c2c-90a1-467a-81d3-66cb6f0dc1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:55.611712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-15568c2c-90a1-467a-81d3-66cb6f0dc1e3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:55.612911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-15568c2c-90a1-467a-81d3-66cb6f0dc1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:55.669275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:55.696933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:12:56.083222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b3cc-f45a-425a-8415-088085a2acb8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:56.207947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e081b3cc-f45a-425a-8415-088085a2acb8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:56.208279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981cc2-389f-48f8-b9e2-482ce71de5e1 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.208546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981cc2-389f-48f8-b9e2-482ce71de5e1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.208834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72981cc2-389f-48f8-b9e2-482ce71de5e1 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.210386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 14/26] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:12:56.215443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.215729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.216014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.254182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:56.255202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:56.255445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:56.255864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.256150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.256428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.290169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:12:56.295952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:12:56.296786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:12:56.297540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 13/27] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:12:56.298161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:56.313703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:56.392097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 15/28] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:12:56.392879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:56.451574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aa168b-18fd-4397-b9c2-c87a6425e779 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:56.520471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:56.521236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.521529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.521808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.537309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:56.546895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-2afec6c7-6bc5-4544-97fc-48c2dce0a710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:12:56.574295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:12:56.575234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:12:56.576028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:12:56.576028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:12:56.576028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:12:56.576028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 14/29] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:12:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:12:56.578732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631ca2-b1b3-4e12-a147-e3fea36b86f0 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.579027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631ca2-b1b3-4e12-a147-e3fea36b86f0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.579305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69631ca2-b1b3-4e12-a147-e3fea36b86f0 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.582652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 15/30] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:56.583435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631ca2-b1b3-4e12-a147-e3fea36b86f0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:56.637446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ec20a5-96ee-4fde-9254-792553d2d509 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:56.651251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:56.666197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:56.693104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:56.693731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.694014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.694291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.695012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:12:56.695368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:56.699820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8bc5b-e6f6-4c83-a24e-e2df89aa59b2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:56.721141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 16/31] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:56.722408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.722712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.723003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.759690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69631ca2-b1b3-4e12-a147-e3fea36b86f0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:56.770671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:56.772205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:56.816112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:56.816969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:56.817421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:56.817864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:56.818672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:12:56.819162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:56.820685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:56.839442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:12:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:56.840606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:56.859921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 17/33] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:12:56.860967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:56.965572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e120830-6751-4905-8f65-14822e639f6d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:56.976126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:56.983469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118f62d6-021e-4b8a-8706-d51f6c4f8d92 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:56.989867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:57.018624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.020153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.020442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.020725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.024905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.026430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.028597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:12:56 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:57.035168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:57.057624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.058790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.059080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.059358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.060034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.061431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.182119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20f0914-187c-4888-81b1-b77db67e7da2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:57.210160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 18/35] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 17 23:12:56 2022] POST /identity/v3/roles => generated 219 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:12:57.211259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:57.221263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d7beb-8f31-4560-b973-8663de0d7fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.221822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7beb-8f31-4560-b973-8663de0d7fc7 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.222108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7beb-8f31-4560-b973-8663de0d7fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.222388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d7beb-8f31-4560-b973-8663de0d7fc7 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.223096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7beb-8f31-4560-b973-8663de0d7fc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.224628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d7beb-8f31-4560-b973-8663de0d7fc7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.346252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0241c4d-3e3f-49a9-b3d4-bb543fe66213 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:57.373464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 18/36] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:12:57 2022] POST /identity/v3/projects => generated 301 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:12:57.375450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6229-914a-4d8a-8af4-96b4b604ca45 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.375954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6229-914a-4d8a-8af4-96b4b604ca45 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.376242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804a6229-914a-4d8a-8af4-96b4b604ca45 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.377540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 19/37] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:57.383731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6229-914a-4d8a-8af4-96b4b604ca45 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:57.391282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f2724-b037-4600-b506-94674568a4ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.392215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2724-b037-4600-b506-94674568a4ba None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.392502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2724-b037-4600-b506-94674568a4ba None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.392783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2724-b037-4600-b506-94674568a4ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.394430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f2724-b037-4600-b506-94674568a4ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.396117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f2724-b037-4600-b506-94674568a4ba None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.397838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:12:57.404517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040770-f468-4d24-bf74-c7169561c3fc None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.405118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040770-f468-4d24-bf74-c7169561c3fc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.405353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03040770-f468-4d24-bf74-c7169561c3fc None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.406944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 20/39] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:57 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:57.408528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.409072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.409674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.430282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:57.431907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:57.437041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:57.462991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:57.522739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804a6229-914a-4d8a-8af4-96b4b604ca45 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:57.526972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 21/40] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:12:57.534753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:57.574868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f532f91-2703-4088-adc8-b41f28243abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.576593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f532f91-2703-4088-adc8-b41f28243abf None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.577067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f532f91-2703-4088-adc8-b41f28243abf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.577613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f532f91-2703-4088-adc8-b41f28243abf None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.578821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f532f91-2703-4088-adc8-b41f28243abf None admin] RBAC: Authorizing `identity:create_role()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.581236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f532f91-2703-4088-adc8-b41f28243abf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.602086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 20/41] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 17 23:12:57 2022] POST /identity/v3/roles => generated 225 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:12:57.603718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.604007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.604280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.635471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:57.638572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:57.696151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d480cbb7-991e-4967-b88c-8a61ceab9b0e None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:57.742955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.743823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.744331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.744817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] PATH_INFO: `/v3/domains/default/users/d38ffb577def40dfa87abed73eb72b3e/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.747912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=d38ffb577def40dfa87abed73eb72b3e, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.749974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.769867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 22/42] 10.222.0.39 () {58 vars in 1361 bytes} [Wed Aug 17 23:12:57 2022] PUT /identity/v3/domains/default/users/d38ffb577def40dfa87abed73eb72b3e/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:12:57.806144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:57.829486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:57.874593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 21/43] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:12:57.936964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dcfc32-9487-4d15-9881-fb4d1254f6bc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:57.972485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:57.973125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:57.973409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:57.973683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:57.974801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:57.976273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:57.978023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 23/44] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:12:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:12:57.984824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:58.016118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:58.094551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b74ad3-94d0-4a0c-bb37-b9a8bc380e51 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:58.129848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf17724-a65b-484a-b401-21b6ff769272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:58.130476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17724-a65b-484a-b401-21b6ff769272 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:58.130796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17724-a65b-484a-b401-21b6ff769272 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:58.131083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf17724-a65b-484a-b401-21b6ff769272 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:58.131740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf17724-a65b-484a-b401-21b6ff769272 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:58.133207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf17724-a65b-484a-b401-21b6ff769272 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:58.156036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:12:58.166728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 22/45] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:12:57 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:12:58.249932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:12:58.268367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921182e8-191f-4a47-9d0f-ba7f15a66de3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:12:58.308800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8400e6d-cfb5-4f8e-b39c-7b0289cd660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:12:58.309763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400e6d-cfb5-4f8e-b39c-7b0289cd660a None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:58.310059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400e6d-cfb5-4f8e-b39c-7b0289cd660a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:58.310339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8400e6d-cfb5-4f8e-b39c-7b0289cd660a None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:58.311077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8400e6d-cfb5-4f8e-b39c-7b0289cd660a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:12:58.312543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8400e6d-cfb5-4f8e-b39c-7b0289cd660a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:12:58.330086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 24/46] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 17 23:12:58 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:12:59.715523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703cc5-db9d-45cd-a19b-8cc807a31a87 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:59.716069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703cc5-db9d-45cd-a19b-8cc807a31a87 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:59.716069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af703cc5-db9d-45cd-a19b-8cc807a31a87 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:59.717457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 23/47] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:12:59.722695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1ae4-5e4d-4c00-b88b-4f0778d452a0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:12:59.723104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1ae4-5e4d-4c00-b88b-4f0778d452a0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:12:59.723272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551f1ae4-5e4d-4c00-b88b-4f0778d452a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:12:59.740991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-551f1ae4-5e4d-4c00-b88b-4f0778d452a0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:12:59.742185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-551f1ae4-5e4d-4c00-b88b-4f0778d452a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:12:59.809777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 25/48] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:00.080214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af703cc5-db9d-45cd-a19b-8cc807a31a87 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.090215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a2819-a794-4439-be6f-4052c5636fbb None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.090511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a2819-a794-4439-be6f-4052c5636fbb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.090813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a2819-a794-4439-be6f-4052c5636fbb None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.092197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 26/49] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:00.097009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504b97-3892-4001-b2de-975b2706c294 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.097294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504b97-3892-4001-b2de-975b2706c294 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.097575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07504b97-3892-4001-b2de-975b2706c294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.166532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:00.192656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af703cc5-db9d-45cd-a19b-8cc807a31a87 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.221070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-07504b97-3892-4001-b2de-975b2706c294 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:00.222277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-07504b97-3892-4001-b2de-975b2706c294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:00.228198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.228835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.229120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.229395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.239757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:00.244924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:00.246268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:00.247078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 24/50] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:00.252518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.294026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 27/51] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:00.351320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95af8ca-8270-40fa-abb6-ac3027d75976 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.384107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.384717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.385003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.385283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.386487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:00.386830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:00.388228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:00.393146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:00.396664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 25/52] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:00.402635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07504b97-3892-4001-b2de-975b2706c294 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.406359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:00.500308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07504b97-3892-4001-b2de-975b2706c294 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.532701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.533322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.533605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.533879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.535011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:00.536473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:00.538023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 28/53] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:00 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:00.544188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.562000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.634532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:00.647017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaca2a05-c67c-4c77-99ac-5df01ca20ae6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.664687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2952f604-b4fc-47b6-8a58-25c62e9eb715 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.681625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.682251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.682746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.683074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.684180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:00.685628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:00.687220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 26/54] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:00.692887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.699877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.700515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.700804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.701081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.702211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:00.703741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:00.705309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 29/55] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:00.710844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:00.758272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:00.792248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1665fa3-d6e5-4514-bc99-fdaee011600a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.810528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae77840-85f9-4f47-8806-6d90b28ce616 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:00.826119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.826750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.827046 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.827325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.828053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.domain.id=default, user.id=d38ffb577def40dfa87abed73eb72b3e) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:00.828365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:00.829803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a9f841-a456-4b1c-a601-a5294b03791c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:00.835422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 27/56] 10.222.0.39 () {56 vars in 1322 bytes} [Wed Aug 17 23:13:00 2022] GET /identity/v3/role_assignments?user.id=d38ffb577def40dfa87abed73eb72b3e&scope.domain.id=default&role.id=585c0d47a790421289bad938a0377b4f => generated 530 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:00.844260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05f0022-4525-4d84-9b6a-fce2e6667a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:00.844897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f0022-4525-4d84-9b6a-fce2e6667a7a None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:00.845192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f0022-4525-4d84-9b6a-fce2e6667a7a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:00.845473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05f0022-4525-4d84-9b6a-fce2e6667a7a None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:00.846141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f0022-4525-4d84-9b6a-fce2e6667a7a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:00.847680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05f0022-4525-4d84-9b6a-fce2e6667a7a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:00.861537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:00.880408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 30/57] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Aug 17 23:13:00 2022] POST /identity/v3/projects => generated 298 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:13:02.830549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550aba2-99cd-4346-8f9d-8d6d60189db7 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:02.831118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550aba2-99cd-4346-8f9d-8d6d60189db7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:02.831118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550aba2-99cd-4346-8f9d-8d6d60189db7 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:02.832481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 28/58] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:02.837477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:02.837864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:02.838038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:02.856350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:02.857530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:02.921884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 31/59] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:03.196585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550aba2-99cd-4346-8f9d-8d6d60189db7 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:03.297759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8550aba2-99cd-4346-8f9d-8d6d60189db7 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:03.328416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:03.333407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e238a264-e16a-4d61-9b2c-6a0280c4bac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:03.334035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a264-e16a-4d61-9b2c-6a0280c4bac5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:03.334318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a264-e16a-4d61-9b2c-6a0280c4bac5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:03.334595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e238a264-e16a-4d61-9b2c-6a0280c4bac5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:03.335743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238a264-e16a-4d61-9b2c-6a0280c4bac5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:03.337179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e238a264-e16a-4d61-9b2c-6a0280c4bac5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:03.338814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 29/60] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:03.344308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:03.441644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc922cda-55f6-462d-801e-3a886e2ba6bb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:03.464411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:03.476097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6802690-8122-480f-8740-558f2b166eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:03.476705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802690-8122-480f-8740-558f2b166eaa None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:03.476991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802690-8122-480f-8740-558f2b166eaa None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:03.477270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6802690-8122-480f-8740-558f2b166eaa None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:03.477909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802690-8122-480f-8740-558f2b166eaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:03.479428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6802690-8122-480f-8740-558f2b166eaa None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:03.503898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 32/61] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:03 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:06.468879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a1c17-334b-44a8-9477-d07b42eb3859 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:06.469900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a1c17-334b-44a8-9477-d07b42eb3859 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:06.470387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399a1c17-334b-44a8-9477-d07b42eb3859 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:06.472205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 30/62] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:06.477532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c8186-3b29-4bf6-b56d-530283174290 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:06.477929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c8186-3b29-4bf6-b56d-530283174290 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:06.478094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c8186-3b29-4bf6-b56d-530283174290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:06.499941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-161c8186-3b29-4bf6-b56d-530283174290 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:06.501156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-161c8186-3b29-4bf6-b56d-530283174290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:06.605432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 33/63] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:06.647149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c0b1-3c6d-4de7-a0a9-478015dedea6 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:06.647782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c0b1-3c6d-4de7-a0a9-478015dedea6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:06.648261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c0b1-3c6d-4de7-a0a9-478015dedea6 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:06.649837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 31/64] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:06.659927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b307-188a-4320-8862-b4056df586dc None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:06.660227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b307-188a-4320-8862-b4056df586dc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:06.660515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c67b307-188a-4320-8862-b4056df586dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:06.684035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1c67b307-188a-4320-8862-b4056df586dc None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:06.685269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1c67b307-188a-4320-8862-b4056df586dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:06.767829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 34/65] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:06.922828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c0b1-3c6d-4de7-a0a9-478015dedea6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:06.985911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4702f-098d-4dcf-a323-42829fc840dc None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:06.986203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4702f-098d-4dcf-a323-42829fc840dc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:06.986769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a4702f-098d-4dcf-a323-42829fc840dc None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:06.988326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 35/66] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:06.993172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:06.993703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:06.994186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.028400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:07.030225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:07.052240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c0b1-3c6d-4de7-a0a9-478015dedea6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.081340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.093032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.093750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.094126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.094409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.107031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:07.115451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:07.116501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:07.117434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:07.119971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 32/67] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:07.121620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.139868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 36/68] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:07.141063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.205896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.251726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceef5914-2508-47ef-9d3d-26022b673a7f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.257611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9998341-65d6-4326-a4d7-d8132650ee0d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.290308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.291144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.292107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.292389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.293068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:07.293376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:07.294831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd563005-839a-4d32-90a6-4928f655df22 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:07.299987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e75961-e41b-4d4b-8c06-08ed7a1050a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.300629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e75961-e41b-4d4b-8c06-08ed7a1050a5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.300921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e75961-e41b-4d4b-8c06-08ed7a1050a5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.301204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e75961-e41b-4d4b-8c06-08ed7a1050a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.303741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 37/69] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:07.304925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438aef2-f3f9-45b2-8bd2-b4f478fa4b9a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.305218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438aef2-f3f9-45b2-8bd2-b4f478fa4b9a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.305500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d438aef2-f3f9-45b2-8bd2-b4f478fa4b9a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.306791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 38/70] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:07.308391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44a60-2dab-4d8d-8961-2522c46e1b50 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.308755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44a60-2dab-4d8d-8961-2522c46e1b50 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.309112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb44a60-2dab-4d8d-8961-2522c46e1b50 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.310306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 39/71] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:07.314743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44a60-2dab-4d8d-8961-2522c46e1b50 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.321749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e75961-e41b-4d4b-8c06-08ed7a1050a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-35e75961-e41b-4d4b-8c06-08ed7a1050a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:07.329006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:07.329852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:07.330618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 33/72] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:07.331949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c28165-97fd-4b87-896c-33fe2a9b29e7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.331949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c28165-97fd-4b87-896c-33fe2a9b29e7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.331949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c28165-97fd-4b87-896c-33fe2a9b29e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.349834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c8c28165-97fd-4b87-896c-33fe2a9b29e7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:07.351065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c8c28165-97fd-4b87-896c-33fe2a9b29e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:07.351745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.424862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 34/73] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:07.426561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.427110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.427581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.441042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb44a60-2dab-4d8d-8961-2522c46e1b50 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.447452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:07.449817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:07.475735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.476301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.476587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.476855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.491598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:07.493028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:07.496107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 40/74] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:07.496703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.509257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.534430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 35/75] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:07.535633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.614313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.631956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ce42f2-7558-4d5a-95a5-b00c0732579c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.669965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e5c1f6-8c93-4353-8bc0-6b5cbb9a71b9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.671331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.672138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.672570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.673056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.673934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:07.674434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:07.676124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:07.686047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 41/76] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:07.687254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.715427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.716335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.716796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.717267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.728321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:07.733409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:07.734245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:07.735040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:07.736879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 36/77] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:07.737904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.785083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.792469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6204ed-1dcc-4ff4-b7e4-4fb04e80de65 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.827594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.828208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.828497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.828774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.847303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:07.848924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbd5215-8851-4c0c-86f2-d275a157dde3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.884324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:07.884959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:07.885761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:07.886058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:07.887392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:07.888835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:07.890425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 37/78] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:07.895593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:07.896158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:07.897625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:07.992704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92136e04-3930-417d-bcb0-cf8dcc79d94a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:07.993614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 42/79] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:07.999231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.003043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.029617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.030247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.030534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.030842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.040728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:08.046077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:08.047167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:08.047921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 38/80] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:08.048555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.050015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.100247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9a31a-d80e-4228-8993-e2a2efd0aeb5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.133216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.133842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.134136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.134421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.135680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:08.135987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.137500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.145394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 43/81] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.146200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.163108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90219cd-54fa-421c-9b13-762fa42b85d3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.198721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.199363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.199649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.199965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.201087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.202535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.204380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 39/82] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.204901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.239093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.249509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d103a-3faa-4420-80d5-9c3c21b13eeb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.261952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.288712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.289323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.289611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.289889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.308691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252dff2c-130a-471d-8c46-02dcb0f515be None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.342092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.342817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.343034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.343308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.344429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.345866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.347515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 40/83] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.348280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.362623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.364143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.452496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24b850e-149a-4e31-a386-549d2b0474a9 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.454807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.465977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 44/84] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:08.466845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.482021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.489876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.490491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.490872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.491153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.491835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:08.492143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.493515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.502085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 41/85] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.503322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.585942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3081a9-773e-4e57-911c-71abe2a19c10 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.615301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fdcd4-6144-4a6c-87d0-c704863fafea None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.626858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.627706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.627996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.628284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.629496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.631173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.632927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 45/86] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.639424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.653428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.654416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.654792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.655140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.655848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.657356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.685846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 42/87] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:08 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:08.686972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.716356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.758398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:08.788466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6bd687-87d7-4d64-8a18-b4e88682e602 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.826791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a1987f-acda-460f-89d4-525e1635b022 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:08.847913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.848261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.848554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.848836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.849615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=8bcfcb5c3316435d8f5f66c269154e75) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:08.849935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.852085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.863828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 46/88] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/role_assignments?user.id=8bcfcb5c3316435d8f5f66c269154e75&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=63bab4de085f498f963ba60424cdcde1 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.868097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:08.876943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:08.877705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:08.878477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:08.878477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:08.879767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:08.881287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:08.886871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 43/89] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:08.892008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:09.028596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:09.029166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b68f377-d2fe-4de3-9bd5-3defe68e74fb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:09.042222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2501d95-3beb-4330-9a09-e3aacc662117 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:09.078606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:09.079306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:09.079593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:09.079869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:09.080998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:09.082437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:09.085463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 47/90] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:09.086206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:09.086338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:09.087116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:09.087559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:09.088030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:09.106126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:09.168888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:09.170385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:09.211026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542cee9-458b-44ab-b99b-e3ef0fc16f1a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:09.260617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:09.261397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:09.261683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:09.261955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:09.262717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:09.263516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=d38ffb577def40dfa87abed73eb72b3e) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:09.263828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:09.265313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:09.271344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 48/91] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:09 2022] GET /identity/v3/role_assignments?user.id=d38ffb577def40dfa87abed73eb72b3e&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:09.273253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 44/92] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:09.278446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:09.285451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:09.435111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:09.469161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71169e84-a5e7-43b7-a552-8658cb8a6b88 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:09.488880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ca6a6-c339-4a02-a441-b647d78d3a90 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:09.517573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:09.518216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:09.518493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:09.518806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:09.576832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:09.577855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:09.578357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:09.578867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:09.583427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:09.585228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:09.587302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 45/93] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:09 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:09.594415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:09.654730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:09.654730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:09.701392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:09.782048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c2909f-4ef8-4505-9ce7-fb7139afd54f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:09.799058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:09.842990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 49/94] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:09.845660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:09.857644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:09.858270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:09.858560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:09.858869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:09.859621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] RBAC: Adding query filter params (role.id=8c530229735042e8958733424a56358b, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=8bcfcb5c3316435d8f5f66c269154e75) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:09.859937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:09.861472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:09.872021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 46/95] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:09 2022] GET /identity/v3/role_assignments?user.id=8bcfcb5c3316435d8f5f66c269154e75&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=8c530229735042e8958733424a56358b => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:10.000953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe588aa-7e54-45fb-a745-8bec15678dce None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:10.038250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4645841f-cb10-491c-8a56-2de1bd5d0fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:10.038940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645841f-cb10-491c-8a56-2de1bd5d0fb0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:10.039230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645841f-cb10-491c-8a56-2de1bd5d0fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:10.039511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645841f-cb10-491c-8a56-2de1bd5d0fb0 None admin] PATH_INFO: `/v3/projects/87e20045770945e1973cabc8c73d7e4e` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:10.040664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645841f-cb10-491c-8a56-2de1bd5d0fb0 None admin] RBAC: Authorizing `identity:get_project(project_id=87e20045770945e1973cabc8c73d7e4e)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:10.042190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4645841f-cb10-491c-8a56-2de1bd5d0fb0 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:10.043888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 50/96] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:09 2022] GET /identity/v3/projects/87e20045770945e1973cabc8c73d7e4e => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:10.049925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:10.161843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed371db4-2524-4e05-8b97-c87ea098280c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:10.186201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:10.199178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:10.199811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:10.200283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:10.200821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:10.201629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=87e20045770945e1973cabc8c73d7e4e, user.id=8bcfcb5c3316435d8f5f66c269154e75) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:10.201946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:10.203517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805985a1-742c-4b74-9cec-8f1f2a6324f5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:10.209458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 47/97] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:10 2022] GET /identity/v3/role_assignments?user.id=8bcfcb5c3316435d8f5f66c269154e75&scope.project.id=87e20045770945e1973cabc8c73d7e4e&role.id=63bab4de085f498f963ba60424cdcde1 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:11.748002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a2e36-8c55-450a-83b3-3492a5a7a821 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:11.749014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a2e36-8c55-450a-83b3-3492a5a7a821 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:11.749525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36a2e36-8c55-450a-83b3-3492a5a7a821 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:11.751093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 51/98] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:11.756401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f57f-d1c9-4039-912e-75a48323d956 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:11.757206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f57f-d1c9-4039-912e-75a48323d956 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:11.757683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f57f-d1c9-4039-912e-75a48323d956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:11.776632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d260f57f-d1c9-4039-912e-75a48323d956 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:11.778116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d260f57f-d1c9-4039-912e-75a48323d956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:11.804441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3b1cf-7630-4d90-ad36-ed39989d7940 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:11.805039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3b1cf-7630-4d90-ad36-ed39989d7940 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:11.805514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3b1cf-7630-4d90-ad36-ed39989d7940 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:11.807148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 52/99] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:11.815997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8986e-a584-4378-8079-045b55a61084 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:11.816536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8986e-a584-4378-8079-045b55a61084 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:11.817034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc8986e-a584-4378-8079-045b55a61084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:11.847903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-efc8986e-a584-4378-8079-045b55a61084 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:11.849551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-efc8986e-a584-4378-8079-045b55a61084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:11.880685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 48/100] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:11.881977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474586-3a8b-4278-898b-d1ff12d82430 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:11.882268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474586-3a8b-4278-898b-d1ff12d82430 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:11.882544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a474586-3a8b-4278-898b-d1ff12d82430 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:11.884064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 49/101] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:11.889879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0274-d6eb-4b38-ba55-9f922e185ddb None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:11.890170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0274-d6eb-4b38-ba55-9f922e185ddb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:11.890451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc0274-d6eb-4b38-ba55-9f922e185ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:11.909384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b0cc0274-d6eb-4b38-ba55-9f922e185ddb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:11.910587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b0cc0274-d6eb-4b38-ba55-9f922e185ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:11.912558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:11.951873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 53/102] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:12.005089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 50/103] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:12.136498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e80a-967a-4401-a2be-af3123e6c508 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.136812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e80a-967a-4401-a2be-af3123e6c508 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.137066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51e80a-967a-4401-a2be-af3123e6c508 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.138419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 54/104] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:12.151994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.152285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.152564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.175129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:12.176367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:12.233886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:12.266775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 51/105] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:12.332086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e80a-967a-4401-a2be-af3123e6c508 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.437278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a51e80a-967a-4401-a2be-af3123e6c508 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:12.473644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:12.474750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.475262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.475738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.487874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:12.494730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:12.495581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:12.496335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:12.502961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 55/106] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:12.507846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.514026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.566332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:12.650160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e532a0-3ba8-4def-a8af-56dd1a24404d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:12.693547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:12.694212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.694503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.694794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.695923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:12.697440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:12.702747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 56/107] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:12.702747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.735708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d8a5e-fbf9-4226-a51a-5278f8897208 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:12.772992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:12.774275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.774568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.774881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.776298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] RBAC: Adding query filter params (name=reader) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:12.776608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:12.778001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280c5ec2-641c-4d0f-bb37-f6c647aeaa9b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:12.786651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 52/108] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:12.787894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500baecb-5982-4214-a8f6-2d25eb81c475 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.788187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500baecb-5982-4214-a8f6-2d25eb81c475 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.788471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500baecb-5982-4214-a8f6-2d25eb81c475 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.794618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 53/109] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:12.795477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500baecb-5982-4214-a8f6-2d25eb81c475 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.820960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa082b7-14f3-43a8-a20a-92485c8801b5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:12.823473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:12.839701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:12.858549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:12.859211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.859497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.859772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.870466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:12.875589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:12.876449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:12.877238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 57/110] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:12.877984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.910350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500baecb-5982-4214-a8f6-2d25eb81c475 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:12.945290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:12.945904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:12.946187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:12.946464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:12.947230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:12.948685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:12.976046 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 54/111] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:13:12 2022] POST /identity/v3/projects => generated 302 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:12.976884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:12.988402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8f043-5eea-410f-852b-f80322430e75 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.031576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b479e2c5-744e-492f-b901-df1e6a00893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.032231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e2c5-744e-492f-b901-df1e6a00893e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.032517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e2c5-744e-492f-b901-df1e6a00893e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.032791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b479e2c5-744e-492f-b901-df1e6a00893e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.044649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b479e2c5-744e-492f-b901-df1e6a00893e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b479e2c5-744e-492f-b901-df1e6a00893e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:13.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:13.050890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:13.051685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 58/112] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:13.056246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.057136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.057427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.076740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:13.077896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:13.085695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.097539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.100587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c689d-8edf-4b5d-af6b-a8ff8d410d8c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.144765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982832f-e322-4b90-84c5-c4151a3b2ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.145461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982832f-e322-4b90-84c5-c4151a3b2ba7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.145754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982832f-e322-4b90-84c5-c4151a3b2ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.146033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982832f-e322-4b90-84c5-c4151a3b2ba7 None admin] PATH_INFO: `/v3/users/ffba785f446c414184355904d1a4eabe` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.161538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 59/113] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:13.162646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.164351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982832f-e322-4b90-84c5-c4151a3b2ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=ffba785f446c414184355904d1a4eabe)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.167315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3982832f-e322-4b90-84c5-c4151a3b2ba7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.169135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 55/114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:12 2022] GET /identity/v3/users/ffba785f446c414184355904d1a4eabe => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:13.173592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3de4-4fa8-454a-915a-33538feb2ed0 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.173592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3de4-4fa8-454a-915a-33538feb2ed0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.173592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba3de4-4fa8-454a-915a-33538feb2ed0 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.173592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 56/115] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:13.173592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3de4-4fa8-454a-915a-33538feb2ed0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.277745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c9fc6-7f45-49d7-920e-722efc191ec9 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.281807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba3de4-4fa8-454a-915a-33538feb2ed0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.315321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.315954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.316347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.316641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.317526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:13.317842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.319351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.319493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.320060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.320409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.320752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.321481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:13.321851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.323884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e18431-28ee-4214-9c5e-d4fbf3480148 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.329065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 60/116] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:13.329971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.337101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 57/117] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:13.338583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.338899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.339183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.347402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.358419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:13.359694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:13.362618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.433311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 58/118] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:13.433995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.448209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71ef80-353b-4226-ac48-57ca1d69c678 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.493619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.494896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.495434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.495721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.547227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6838c8-21d9-44e9-b20a-8f65ae835aad None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.592410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.594351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.595607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.596503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.596824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.597978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.599166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.600661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.602314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 59/119] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:13.603763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.614827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.618340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.725621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 61/120] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:13.726566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.733724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d037ff8-8eca-40ba-959a-b27945aa4118 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.770146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.770806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.771090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.771365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.772490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.773921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.776238 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 60/121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:13.779872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.838847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51249004-82b7-40d6-bb57-098e09deff1c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.853414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.861845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:13.876394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.877343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.877769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.878044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.886024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea3f1c-2adc-4436-8468-ad834c7386d5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:13.889723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:13.894379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:13.895243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:13.896003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 62/122] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:13.897570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:13.927296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:13.927942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:13.928237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:13.928525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:13.929651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:13.931138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:13.932922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 61/123] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:13.933701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.015531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415fad42-a234-4fa6-95b0-3e244bccb3dc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.039762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ea554-b3e0-454f-80f8-ec6610b0eba4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.053091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.053791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.054085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.054373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.055566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.057204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.059057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 63/124] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.059733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.081481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.082123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.082409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.082689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.094222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:14.099064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:14.099917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:14.100672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 62/125] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:14.101339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.106420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.110884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.176928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b264342-524b-415b-8568-d89dbdbcb8b3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.213889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.214532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.214855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.215140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.215932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0209c6a4-549c-4052-8c1f-8f3136eaff77 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.216276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.217753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.224152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 64/126] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.224152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.253889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.254500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.254814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.255093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.255769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:14.256081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.257469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.266978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 63/127] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.267865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.327410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17749091-02e3-49c7-9468-4a3ca780f22b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.337543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.341851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.365618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.366493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.366818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.367100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/8bcfcb5c3316435d8f5f66c269154e75/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.369999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f4b1e629c4f22bcdab682d614609c, user_id=8bcfcb5c3316435d8f5f66c269154e75, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.371812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.382574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b811d54f-cfbe-40bc-b0d3-d81d405c4e11 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.387342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 65/128] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:14 2022] PUT /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/8bcfcb5c3316435d8f5f66c269154e75/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:14.388182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.437152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.437852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.438138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.438413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.439190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] RBAC: Adding query filter params (role.id=06e64363f6d940708ca457ba5bb23067, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=ffba785f446c414184355904d1a4eabe) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:14.439503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.440996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.448024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 64/129] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/role_assignments?user.id=ffba785f446c414184355904d1a4eabe&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=06e64363f6d940708ca457ba5bb23067 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.448886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.537057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5cab5-5077-43b8-ae97-39b0e630fbb1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.586865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c95f919-4c80-4701-8a00-8d15b68b58d3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.591411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.592058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.592342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.592617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.593333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:14.593640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.595275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.611475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 66/130] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.612371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.637835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.645299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.645985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.646274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.646557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/d38ffb577def40dfa87abed73eb72b3e/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.648597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f4b1e629c4f22bcdab682d614609c, user_id=d38ffb577def40dfa87abed73eb72b3e, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.650079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.661659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.672267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:14 2022] PUT /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/d38ffb577def40dfa87abed73eb72b3e/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:14.673283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.772180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d931b67-c4c8-49bc-a87a-ee1c62ca81cc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.789931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8effdd4f-b2d3-4ff4-b3c7-9fbf97974ef5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.827726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.828395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.828682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.828969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.830227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.831758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.833400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 66/132] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.834016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.834685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.834987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.835337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.839312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.839578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.841044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:14.843134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 67/133] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:14.868448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:14.911480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:14.956465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df3de0-fbad-422a-9c52-c6b1f9c37f9f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:14.994547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:14.995421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:14.995808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:14.996098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:14.997368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:14.998887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:15.000761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 67/134] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:15.006640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:15.034081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:15.037002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ee424d-f717-4d7a-8d2f-b530324df685 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:15.107384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6275637c-e6d7-4e4e-a41b-a3176fec1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:15.108357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275637c-e6d7-4e4e-a41b-a3176fec1f00 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:15.108645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275637c-e6d7-4e4e-a41b-a3176fec1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:15.109042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6275637c-e6d7-4e4e-a41b-a3176fec1f00 None admin] PATH_INFO: `/v3/projects/87e20045770945e1973cabc8c73d7e4e` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:15.110324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275637c-e6d7-4e4e-a41b-a3176fec1f00 None admin] RBAC: Authorizing `identity:get_project(project_id=87e20045770945e1973cabc8c73d7e4e)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:15.112569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6275637c-e6d7-4e4e-a41b-a3176fec1f00 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:15.118774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 68/135] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:14 2022] GET /identity/v3/projects/87e20045770945e1973cabc8c73d7e4e => generated 312 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:15.118774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d992-0d9f-408b-8db2-6f05b15f284d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:15.118774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d992-0d9f-408b-8db2-6f05b15f284d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:15.118774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240d992-0d9f-408b-8db2-6f05b15f284d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:15.118774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 69/136] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:15.121657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240d992-0d9f-408b-8db2-6f05b15f284d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:15.124137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25c1b9a-9dd4-4def-bbc7-c256cce7c8e5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:15.165836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:15.178720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93efdf-4640-4b61-aa3c-434b2c2eb3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:15.179794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93efdf-4640-4b61-aa3c-434b2c2eb3c3 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:15.180598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93efdf-4640-4b61-aa3c-434b2c2eb3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:15.180940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93efdf-4640-4b61-aa3c-434b2c2eb3c3 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/8bcfcb5c3316435d8f5f66c269154e75/roles/8c530229735042e8958733424a56358b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:15.184753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93efdf-4640-4b61-aa3c-434b2c2eb3c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f4b1e629c4f22bcdab682d614609c, user_id=8bcfcb5c3316435d8f5f66c269154e75, role_id=8c530229735042e8958733424a56358b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:15.186320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93efdf-4640-4b61-aa3c-434b2c2eb3c3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:15.215888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 68/137] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:15 2022] PUT /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/8bcfcb5c3316435d8f5f66c269154e75/roles/8c530229735042e8958733424a56358b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:13:15.218413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:15.218732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:15.219018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:15.261077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:15.265512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:15.294491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a240d992-0d9f-408b-8db2-6f05b15f284d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:15.350225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:15.351593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:15.351890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:15.352177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] PATH_INFO: `/v3/projects/87e20045770945e1973cabc8c73d7e4e/users/8bcfcb5c3316435d8f5f66c269154e75/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:15.355005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=87e20045770945e1973cabc8c73d7e4e, user_id=8bcfcb5c3316435d8f5f66c269154e75, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:15.356633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:15.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 70/138] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:15 2022] PUT /identity/v3/projects/87e20045770945e1973cabc8c73d7e4e/users/8bcfcb5c3316435d8f5f66c269154e75/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:13:15.433506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 69/139] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:15.818483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:15.859149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:15.949961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8094ad-6cf6-4e13-b6dd-c0881703e3e4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:15.985460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e56425-d2d6-4c33-a037-a6e5a57dc576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:15.986443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56425-d2d6-4c33-a037-a6e5a57dc576 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:15.986969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56425-d2d6-4c33-a037-a6e5a57dc576 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:15.987450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e56425-d2d6-4c33-a037-a6e5a57dc576 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:15.988786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56425-d2d6-4c33-a037-a6e5a57dc576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:15.990491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e56425-d2d6-4c33-a037-a6e5a57dc576 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:15.992653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 71/140] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:15.999783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:16.155946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f977a74-bd37-46d4-9060-8c7264d401da None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:16.182749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:16.206862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf111bf-f8aa-4ae4-99e1-bc5bb0dd1edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:16.207491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf111bf-f8aa-4ae4-99e1-bc5bb0dd1edc None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:16.207784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf111bf-f8aa-4ae4-99e1-bc5bb0dd1edc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:16.208074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf111bf-f8aa-4ae4-99e1-bc5bb0dd1edc None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:16.208817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf111bf-f8aa-4ae4-99e1-bc5bb0dd1edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:16.210267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf111bf-f8aa-4ae4-99e1-bc5bb0dd1edc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:16.245800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 70/141] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:15 2022] POST /identity/v3/users => generated 283 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:17.271389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bb84-e235-4b4a-b844-b5a1db43cd67 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:17.272346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bb84-e235-4b4a-b844-b5a1db43cd67 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:17.272826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81bb84-e235-4b4a-b844-b5a1db43cd67 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:17.274622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 72/142] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:17.284222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e9d8-330e-42da-9ec3-ba905a634da4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:17.285112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e9d8-330e-42da-9ec3-ba905a634da4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:17.285578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9758e9d8-330e-42da-9ec3-ba905a634da4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:17.308651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9758e9d8-330e-42da-9ec3-ba905a634da4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:17.309865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9758e9d8-330e-42da-9ec3-ba905a634da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:17.398458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 71/143] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:17.454430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb49d-fd66-473a-b427-f5a84403c432 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:17.454742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb49d-fd66-473a-b427-f5a84403c432 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:17.455026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9bb49d-fd66-473a-b427-f5a84403c432 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:17.456378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 73/144] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:17.461768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44343f-e629-4b5f-b62b-269f7302ea61 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:17.462067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44343f-e629-4b5f-b62b-269f7302ea61 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:17.462354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44343f-e629-4b5f-b62b-269f7302ea61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:17.484442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-4c44343f-e629-4b5f-b62b-269f7302ea61 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:17.485652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4c44343f-e629-4b5f-b62b-269f7302ea61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:17.574642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 72/145] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:17.745518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca0b5-47ba-4a29-8b1d-34bdb54b8e95 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:17.745867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca0b5-47ba-4a29-8b1d-34bdb54b8e95 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:17.746158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baca0b5-47ba-4a29-8b1d-34bdb54b8e95 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:17.747817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 74/146] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:17.757924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:17.758213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:17.758500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:17.785505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:17.786791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:17.828369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:17.878127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 73/147] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:17.970103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baca0b5-47ba-4a29-8b1d-34bdb54b8e95 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:18.078989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:18.086482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baca0b5-47ba-4a29-8b1d-34bdb54b8e95 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:18.124094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:18.124738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.125022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.125315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.137290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:18.142417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:18.144835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:18.147541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 75/148] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:18.152379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:18.286103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:18.307152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146ddda3-9251-4fe6-a057-9965ed7e2644 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:18.362191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:18.363048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.363386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.363670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.364351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:18.365126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:18.366784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320d2656-fd1f-4052-9f97-50165e949e53 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:18.377982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 74/149] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:18.379826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63ab69-3434-4f4b-ad0b-b010e6cabbed None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.380114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63ab69-3434-4f4b-ad0b-b010e6cabbed None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.380386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63ab69-3434-4f4b-ad0b-b010e6cabbed None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.381625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 75/150] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:18.385340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63ab69-3434-4f4b-ad0b-b010e6cabbed None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:18.419940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:18.440411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaaa139-8a82-45bc-af09-da4d832ca055 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:18.514226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7fe4ce-52e3-4adc-9713-cc82e9924fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:18.514942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fe4ce-52e3-4adc-9713-cc82e9924fe1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.515234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fe4ce-52e3-4adc-9713-cc82e9924fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.515574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7fe4ce-52e3-4adc-9713-cc82e9924fe1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.533226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7fe4ce-52e3-4adc-9713-cc82e9924fe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-be7fe4ce-52e3-4adc-9713-cc82e9924fe1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:18.538048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:18.538955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:18.539703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 76/151] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:18.540849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0954a1-a0e1-43d5-9e27-7f6edbc178ae None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.540849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0954a1-a0e1-43d5-9e27-7f6edbc178ae None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.541161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63ab69-3434-4f4b-ad0b-b010e6cabbed None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:18.541333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0954a1-a0e1-43d5-9e27-7f6edbc178ae None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.542494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 77/152] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:18.543531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370a0e-8a85-425c-ab9a-af2be0814284 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.543816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370a0e-8a85-425c-ab9a-af2be0814284 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.544196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b370a0e-8a85-425c-ab9a-af2be0814284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.563864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6b370a0e-8a85-425c-ab9a-af2be0814284 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:18.565074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6b370a0e-8a85-425c-ab9a-af2be0814284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:18.583053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:18.611168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:18.611808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.612089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.612417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.633571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:18.639482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:18.641565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 76/153] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:18.643506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:18.697988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 78/154] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:18.700344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.700636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.700913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.735384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:18.736578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:18.824502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:18.865658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67e3cdb-3bf3-4781-a0c8-83af014301bd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:18.940022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 79/155] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:18.941315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:18.956487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:18.957143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:18.957428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:18.957707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:18.963649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:18.965224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:18.966992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 77/156] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:18 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:18.967606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:19.131315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:19.170892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ee46a9-2585-404d-b1b1-52b055af3e6b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:19.172882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ca74-792f-4c48-a50a-7e1e98dc0c55 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:19.250002 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:19.252617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:19.253413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:19.254343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:19.255604 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:19.256625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:19.257411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:19.259598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:19.260485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:19.260952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:19.261412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:19.263666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] RBAC: Adding query filter params (name=reader) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:19.264158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:19.266563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:19.282838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 78/157] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:19.284904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:19.292374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 80/158] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:19.293232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:19.323069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:19.476879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b55b5-b0d7-4078-816a-999286c8553a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:19.495782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77eb426-c188-4ce3-a0a5-e76072dbb133 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:19.520753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:19.521398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:19.521684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:19.521962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:19.535334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:19.540979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:19.542931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:19.547247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:19.548151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 81/159] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:19.549505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:19.550339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:19.550339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:19.550824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:19.627305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:19.628791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:19.644323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:19.747432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f080cd6-14cd-445c-a79c-fa1272ba2cb0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:19.796949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 79/160] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:19.797624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:19.817761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:19.818407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:19.818693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:19.818998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] PATH_INFO: `/v3/users/d38ffb577def40dfa87abed73eb72b3e` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:19.820779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] RBAC: Authorizing `identity:get_user(user_id=d38ffb577def40dfa87abed73eb72b3e)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:19.822316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:19.823938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 82/161] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:19 2022] GET /identity/v3/users/d38ffb577def40dfa87abed73eb72b3e => generated 247 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:19.824708 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:19.967141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.001996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f11277-ecb3-48e5-8d93-f79d7e9480e2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.025139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.027729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea08322d-4ba8-445f-8084-25ef51471a54 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.050395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.051377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.051835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.052280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] PATH_INFO: `/v3/users/ffba785f446c414184355904d1a4eabe` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.053590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] RBAC: Authorizing `identity:get_user(user_id=ffba785f446c414184355904d1a4eabe)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.055269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.062801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 80/162] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:19 2022] GET /identity/v3/users/ffba785f446c414184355904d1a4eabe => generated 289 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.064033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.115247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.116227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.116692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.117149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.138886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:20.150506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:20.151551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:20.152779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:20.158086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 83/163] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:20.159554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.266840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a96b6c-9664-48a4-bc52-d93ab6906509 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.308275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.309236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.309932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.309932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.310461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:20.310807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.312589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.323664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 81/164] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.325197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.341176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e47d16-f99c-4653-b02d-a45f57f02020 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.373246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.381007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.383413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.384629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.385025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.385307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.386591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.388120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.391245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 84/165] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.391245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.449756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb5d233-023c-4f88-81fb-8b0af0607da0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.489741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b20bf8a-a2e1-4de2-91eb-18bba313a6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.490356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bf8a-a2e1-4de2-91eb-18bba313a6e4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.490643 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bf8a-a2e1-4de2-91eb-18bba313a6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.490953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b20bf8a-a2e1-4de2-91eb-18bba313a6e4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.515707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb188c7-776a-466c-b1ef-83791f4f3b33 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.558612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.559421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.559708 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.559985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.561135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.562601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.569261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 85/166] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.569261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.577119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20bf8a-a2e1-4de2-91eb-18bba313a6e4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.579333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b20bf8a-a2e1-4de2-91eb-18bba313a6e4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.636700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.637142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.682471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791926f2-9b80-4a4a-b358-94d1ff5f6754 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.707909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 82/167] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:20.709482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b07d6-8bf2-4d88-91fd-4f5a522b5085 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.709769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b07d6-8bf2-4d88-91fd-4f5a522b5085 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.710045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324b07d6-8bf2-4d88-91fd-4f5a522b5085 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.711648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 83/168] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:20.717797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b07d6-8bf2-4d88-91fd-4f5a522b5085 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.726976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.727601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.728030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.728332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.729017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:20.729320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.730767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de546e50-1989-4beb-bf20-692e198e6892 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.742065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 86/169] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.742710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3fe3-9432-4d64-a044-c4cdf7d9257f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.743050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3fe3-9432-4d64-a044-c4cdf7d9257f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.743525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25a3fe3-9432-4d64-a044-c4cdf7d9257f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.745069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 87/170] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:20.745639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3fe3-9432-4d64-a044-c4cdf7d9257f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.842379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324b07d6-8bf2-4d88-91fd-4f5a522b5085 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.864442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25a3fe3-9432-4d64-a044-c4cdf7d9257f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:20.879713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.880351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.880636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.880912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.882060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.883570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.885273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 84/171] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.886044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:20.890924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.902838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:20.903946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:20.904280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.904610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.905017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.905875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=8bcfcb5c3316435d8f5f66c269154e75) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:20.906228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:20.907807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1c7ca-6a14-4ed3-945a-d547f1a1c601 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:20.913876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 88/172] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/role_assignments?user.id=8bcfcb5c3316435d8f5f66c269154e75&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=63bab4de085f498f963ba60424cdcde1 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:20.915035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392024e-d0a1-435f-9fc2-032d696d7496 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:20.915935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392024e-d0a1-435f-9fc2-032d696d7496 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:20.916296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6392024e-d0a1-435f-9fc2-032d696d7496 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:20.922756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 89/173] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:20.922756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392024e-d0a1-435f-9fc2-032d696d7496 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:21.027610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abf4708-2c65-4fae-9870-41a90ae7faa5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.053685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6392024e-d0a1-435f-9fc2-032d696d7496 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.073204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ba2523-393b-4799-859b-338da39d6419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:21.073902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2523-393b-4799-859b-338da39d6419 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.074182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2523-393b-4799-859b-338da39d6419 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.074454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba2523-393b-4799-859b-338da39d6419 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/ffba785f446c414184355904d1a4eabe/roles/06e64363f6d940708ca457ba5bb23067` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.076477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba2523-393b-4799-859b-338da39d6419 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f4b1e629c4f22bcdab682d614609c, user_id=ffba785f446c414184355904d1a4eabe, role_id=06e64363f6d940708ca457ba5bb23067)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:21.077926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ba2523-393b-4799-859b-338da39d6419 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:21.092158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:21.093043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.093278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.093561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.095037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:21.095417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 85/174] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:20 2022] PUT /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/users/ffba785f446c414184355904d1a4eabe/roles/06e64363f6d940708ca457ba5bb23067 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:21.096557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:21.096932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a4b1-f449-4a7e-8301-63a5349f6cda None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.097352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a4b1-f449-4a7e-8301-63a5349f6cda None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.097772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab37a4b1-f449-4a7e-8301-63a5349f6cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.098220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 90/175] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:20 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:21.099025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:21.124038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ab37a4b1-f449-4a7e-8301-63a5349f6cda None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:21.126605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ab37a4b1-f449-4a7e-8301-63a5349f6cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:21.177406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:21.235512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 86/176] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:21.237209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197241-5d61-45e1-9485-675f61136948 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.237748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197241-5d61-45e1-9485-675f61136948 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.238235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7197241-5d61-45e1-9485-675f61136948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.246498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:21.249484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ecfb9-b175-45dc-9391-4025aa49cbc3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.262255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b7197241-5d61-45e1-9485-675f61136948 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:21.265028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b7197241-5d61-45e1-9485-675f61136948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:21.300989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:21.301639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.301922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.302197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] PATH_INFO: `/v3/users/8bcfcb5c3316435d8f5f66c269154e75` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.304017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] RBAC: Authorizing `identity:get_user(user_id=8bcfcb5c3316435d8f5f66c269154e75)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:21.305500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:21.308022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 91/177] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:21 2022] GET /identity/v3/users/8bcfcb5c3316435d8f5f66c269154e75 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:21.308555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:21.352639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 87/178] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:21.360351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.360749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.361131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.399763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:21.401157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:21.427886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e0699-5fb2-41fe-8a95-7590b4076942 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.453222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:21.465777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:21.466402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.466753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.467112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.546923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:21.548468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:21.556128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 88/179] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:21.557617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:21.641306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:21.661172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 92/180] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:21.662030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:21.693050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6487efcf-74ad-4918-b10e-3205f0908af2 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.700020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:21.738190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:21.738956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.739477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.739761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.740918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=d38ffb577def40dfa87abed73eb72b3e) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:21.741503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:21.744201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:21.751905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 89/181] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:21 2022] GET /identity/v3/role_assignments?user.id=d38ffb577def40dfa87abed73eb72b3e&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:21.753234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:21.827069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f93c0bb-73a1-4a3b-a9a6-8d48297d1011 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.895088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:21.895937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:21.896219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:21.896495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:21.964213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48205317-d059-4923-bb58-d6c172697d48 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:21.996548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.006901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.008045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.008337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.008899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.009645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.011208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.021384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:22.028083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:22.030171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 90/182] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:22.032117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.039511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.135229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 93/183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:22.136090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.162828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1fc7e-5a94-4f81-b63e-b47dd49f975a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.199114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.199748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.200025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.200296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.201414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.202878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.204726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 91/184] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.205319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.248173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78b15e7-f232-41be-a306-ee73e2a4a813 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.266233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.272270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.288618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.289261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.289545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.289822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.302290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:22.307760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:22.308672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:22.309554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 94/185] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:22.310200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.326962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4141c24b-7f0a-4d15-99a4-c93325a7813d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.364045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.364677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.364954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.365209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.366298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.367763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.370745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 92/186] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.370745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.425001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e02ec5c-774f-465d-9636-e498d4e5083b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.467569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.468189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.468448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.468714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.469367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:22.469670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.471189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.477171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cf4002-abac-4dd2-946b-c6f996b4e3b6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.479204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 95/187] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.484474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.501869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.516111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.516744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.517025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.517299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] PATH_INFO: `/v3/projects/87e20045770945e1973cabc8c73d7e4e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.518410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] RBAC: Authorizing `identity:get_project(project_id=87e20045770945e1973cabc8c73d7e4e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.519889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.521631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 93/188] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/projects/87e20045770945e1973cabc8c73d7e4e => generated 312 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.522428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.542489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.599614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc772e-8854-4d01-b262-c1f390ed4fce None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.636452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.637059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.637363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.637611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.638343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] RBAC: Adding query filter params (role.id=8c530229735042e8958733424a56358b, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=8bcfcb5c3316435d8f5f66c269154e75) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:22.638651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.639540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b362c19-5665-487b-b089-80927ff9785b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.640107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.646054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 96/189] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/role_assignments?user.id=8bcfcb5c3316435d8f5f66c269154e75&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=8c530229735042e8958733424a56358b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.646650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.698272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.699603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.699894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.700268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.700994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:22.701337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.702745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.713022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 94/190] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.719176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.781813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.785533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca00585-ec41-4f57-8e02-4b487e0c3998 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.799460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:22.829926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.831399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.832145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.832576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.833231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.834689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.843521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b194878-512c-4fa3-8e32-282ab593439e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:22.859756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 97/191] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:22 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:22.860600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:22.891424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:22.892295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:22.892789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:22.893176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] PATH_INFO: `/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:22.914608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] RBAC: Authorizing `identity:get_user(user_id=33ec884ca5ea49fe8f6553fb38cabaf7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:22.917207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:22.919475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 95/192] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7 => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:22.924944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:23.008419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f0c800-7d49-42d5-b4da-121c4aace644 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.053228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.054106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.054486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.054994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.055932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=87e20045770945e1973cabc8c73d7e4e, user.id=8bcfcb5c3316435d8f5f66c269154e75) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:23.056363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.058168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.064608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 98/193] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/role_assignments?user.id=8bcfcb5c3316435d8f5f66c269154e75&scope.project.id=87e20045770945e1973cabc8c73d7e4e&role.id=63bab4de085f498f963ba60424cdcde1 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:23.065427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:23.066490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4b9bd-92ee-43ac-ade2-50f5c3485ac3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.081476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:23.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:23.123365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.124404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.124883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.125370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] PATH_INFO: `/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.127547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] RBAC: Authorizing `identity:get_user(user_id=33ec884ca5ea49fe8f6553fb38cabaf7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.129863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.133057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 96/194] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:22 2022] GET /identity/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7 => generated 283 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:23.141106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:23.216809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cae134-5c8b-4a19-849d-d8b1e0ad5a91 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.259994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809089f6-8a85-4259-892e-aa215b7d519f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.260944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809089f6-8a85-4259-892e-aa215b7d519f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.261448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809089f6-8a85-4259-892e-aa215b7d519f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.261916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809089f6-8a85-4259-892e-aa215b7d519f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.296346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c40536-a53b-4ec6-93e7-19907e7e787b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.341010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809089f6-8a85-4259-892e-aa215b7d519f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.341231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deec9d2d-0e33-4038-b83c-656498bdf8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.341865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec9d2d-0e33-4038-b83c-656498bdf8a0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.342195 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec9d2d-0e33-4038-b83c-656498bdf8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.342473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deec9d2d-0e33-4038-b83c-656498bdf8a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.342587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809089f6-8a85-4259-892e-aa215b7d519f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.374292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:23.417747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:23.438360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec9d2d-0e33-4038-b83c-656498bdf8a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.440477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deec9d2d-0e33-4038-b83c-656498bdf8a0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.458623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 99/195] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:23.464694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc37ee-0cf2-44d2-8e1e-11196b8ffd2c None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.465199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc37ee-0cf2-44d2-8e1e-11196b8ffd2c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.465630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cc37ee-0cf2-44d2-8e1e-11196b8ffd2c None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.467134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 100/196] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:23.469461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc37ee-0cf2-44d2-8e1e-11196b8ffd2c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:23.569689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 97/197] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:23.571310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.572494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.572922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.597320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:23.599318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:23.615871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cc37ee-0cf2-44d2-8e1e-11196b8ffd2c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.658216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:23.667571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.668473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.668758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.669039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.670893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.672357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.674902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 101/198] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:23 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:23.675979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:23.698340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 98/199] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:23.699257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:23.710439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:23.822197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7720ca-a013-486f-95c9-80f842802e86 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.860407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.860611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12dd52e-cfeb-4b00-8dcb-59c3c22ca2cb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:23.861018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.861302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.861578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.862579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=33ec884ca5ea49fe8f6553fb38cabaf7) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:23.862925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.864393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.871529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 99/200] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:23 2022] GET /identity/v3/role_assignments?user.id=33ec884ca5ea49fe8f6553fb38cabaf7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:23.949900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:23.950624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:23.950939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:23.951221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:23.952416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:23.953881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:23.955568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 102/201] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:23 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:23.964088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:24.009244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:24.067100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:24.092699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de255c89-dfb4-407a-bb99-c00b4f780fd4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:24.130207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:24.130998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:24.131286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:24.131563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:24.132597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] RBAC: Adding query filter params (role.id=8c530229735042e8958733424a56358b, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=33ec884ca5ea49fe8f6553fb38cabaf7) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:24.132920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:24.134687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:24.140826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 100/202] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:23 2022] GET /identity/v3/role_assignments?user.id=33ec884ca5ea49fe8f6553fb38cabaf7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=8c530229735042e8958733424a56358b => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:24.159404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:24.206546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35025cb-ddf8-42ca-a65b-f79e6e8e9a09 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:24.250327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:24.251026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:24.251314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:24.251595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:24.269025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:24.275109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:24.277183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:24.279418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 103/203] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:24.286510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:24.433420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ad56ec-8596-4281-90dc-57c6f012d2d4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:24.477486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:24.479329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:24.479829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:24.480296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:24.481179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:24.481674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:24.483396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:24.488986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:24.498169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 101/204] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:24.504070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:24.629235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f0df79-2f09-456a-9ece-805006d78a57 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:24.657971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:24.667243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:24.668043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:24.668335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:24.668618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] PATH_INFO: `/v3/users/ffba785f446c414184355904d1a4eabe` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:24.669757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] RBAC: Authorizing `identity:get_user(user_id=ffba785f446c414184355904d1a4eabe)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:24.671275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:24.673042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 104/205] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:24 2022] GET /identity/v3/users/ffba785f446c414184355904d1a4eabe => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:24.678557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:24.784010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af06fe07-6255-4145-bdea-478fc2665dc6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:24.840281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:24.840894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:24.841174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:24.841447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:24.933242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:24.937306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:24.939040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:25.060624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 102/206] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:25.065911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:25.216657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ee4eb-292e-4ec2-8416-8110eec64763 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:25.268818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3a2d3-8c50-405d-9263-f88e4df0c6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:25.269875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a2d3-8c50-405d-9263-f88e4df0c6ba None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:25.270352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a2d3-8c50-405d-9263-f88e4df0c6ba None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:25.270841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3a2d3-8c50-405d-9263-f88e4df0c6ba None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:25.272178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a2d3-8c50-405d-9263-f88e4df0c6ba None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:25.273819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3a2d3-8c50-405d-9263-f88e4df0c6ba None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:25.276110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 105/207] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:25 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:25.284885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:25.443332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:25.448602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9565513f-73cd-47c3-b5de-cbb78d0b260b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:25.493762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:25.494426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:25.494727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:25.494999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:25.495727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] RBAC: Adding query filter params (role.id=06e64363f6d940708ca457ba5bb23067, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c, user.id=ffba785f446c414184355904d1a4eabe) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:25.496035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:25.497473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c75a372-1345-4a73-af59-9947cdbd3485 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:25.503776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 103/208] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:25 2022] GET /identity/v3/role_assignments?user.id=ffba785f446c414184355904d1a4eabe&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=06e64363f6d940708ca457ba5bb23067 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:25.547397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877d9f-2433-4c85-b282-1330fa47bab0 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:25.547908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877d9f-2433-4c85-b282-1330fa47bab0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:25.548019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd877d9f-2433-4c85-b282-1330fa47bab0 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:25.549706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 106/209] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:25.556406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9fdb-f71d-4c85-884d-b48928bb9946 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:25.556903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9fdb-f71d-4c85-884d-b48928bb9946 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:25.557442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fd9fdb-f71d-4c85-884d-b48928bb9946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:25.584741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a7fd9fdb-f71d-4c85-884d-b48928bb9946 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:25.585974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a7fd9fdb-f71d-4c85-884d-b48928bb9946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:25.688166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 104/210] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:25.694760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aff3a3-6612-489e-bc1f-f707de945704 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:25.695222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aff3a3-6612-489e-bc1f-f707de945704 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:25.695667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aff3a3-6612-489e-bc1f-f707de945704 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:25.698033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 107/211] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:25.705399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84378d33-84af-47d1-87df-10f5cb5ec6f4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:25.705885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84378d33-84af-47d1-87df-10f5cb5ec6f4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:25.706310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84378d33-84af-47d1-87df-10f5cb5ec6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:25.730424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-84378d33-84af-47d1-87df-10f5cb5ec6f4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:25.731704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-84378d33-84af-47d1-87df-10f5cb5ec6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:25.818034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 105/212] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:25.994147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aff3a3-6612-489e-bc1f-f707de945704 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.080866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.115644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce62b-71f5-44cf-b3f4-ac809b67c361 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.116291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce62b-71f5-44cf-b3f4-ac809b67c361 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.116860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cce62b-71f5-44cf-b3f4-ac809b67c361 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.119535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 106/213] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:26.125083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.125386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.125668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.128244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aff3a3-6612-489e-bc1f-f707de945704 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.144246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:26.145659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:26.163265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.163896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.164023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.164188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.164470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.175719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:26.181079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:26.182028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:26.182866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 108/214] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:26.188231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.227900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 107/215] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:26.229267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.296154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c60aad-b295-4133-a6c3-4a27e476b589 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.322285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.336424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.338186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.338822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.339324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.340859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:26.342577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:26.344614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 109/216] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:26.351045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.357098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e090c7-785f-4973-96df-37f0f94b42c5 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.404285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.405334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.406179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.406924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.407821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:26.408508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:26.410966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:26.422379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 108/217] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:26.427719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.446142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.474870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cadac0-e0a6-41d5-9676-684446eb55ef None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.513557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.514175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.514473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.514759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.515421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:26.516868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:26.537270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93a253f-ac38-4b8f-8407-1fc14396a7c4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.541075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 110/218] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:26 2022] POST /identity/v3/users => generated 297 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:26.542261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.577871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.578918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.579426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.579915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] PATH_INFO: `/v3/users/2b3d7e7911f04fa58b010d84f61dc478` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.596946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d7e7911f04fa58b010d84f61dc478)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:26.598805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:26.606238 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 109/219] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:26 2022] GET /identity/v3/users/2b3d7e7911f04fa58b010d84f61dc478 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:26.607521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.612013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.691761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09a5917-e68d-49ae-9850-58cddfb6b36f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.698501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.735851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a31b9d-069b-49c4-a350-03dfc834ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.736172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1bd97-9ef9-46d0-ac98-47ec3bbd893d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.736502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31b9d-069b-49c4-a350-03dfc834ecba None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.736785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31b9d-069b-49c4-a350-03dfc834ecba None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.737705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a31b9d-069b-49c4-a350-03dfc834ecba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.751292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a31b9d-069b-49c4-a350-03dfc834ecba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b3a31b9d-069b-49c4-a350-03dfc834ecba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:26.756485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:26.757391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:26.758650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 111/220] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:26.759825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb75bb5-cfd9-4741-b283-9d6ef7fbb33f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.759989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb75bb5-cfd9-4741-b283-9d6ef7fbb33f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.761690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb75bb5-cfd9-4741-b283-9d6ef7fbb33f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.761690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 112/221] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:26.764583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb75bb5-cfd9-4741-b283-9d6ef7fbb33f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:26.776985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.777603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.777887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.778428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.871633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:26.873451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:26.907948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb75bb5-cfd9-4741-b283-9d6ef7fbb33f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:26.917544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.958147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:26.959132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.959426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.959726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:26.961021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:26.961339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:26.963247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e36202-e947-4e3c-a6a0-d8e81ae0924a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:26.970936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:26.975335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:26.977048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:26.977880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:26.978292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.003233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:27.005091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:27.007201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 110/223] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:27.007962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.098802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 114/224] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:27.099710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.132761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffab446-21e0-4b62-b009-c65526967dba None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.194880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.195522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.195799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.196192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] PATH_INFO: `/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.198401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] RBAC: Authorizing `identity:get_user(user_id=33ec884ca5ea49fe8f6553fb38cabaf7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:27.199866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:27.203091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 111/225] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:27.206978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.267749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:27.271103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a39f94-0c76-4ca6-9e8f-856d304776ac None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.297123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:27.313918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.314955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.315574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.316064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.317410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:27.319173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:27.321241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 115/226] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:27.327564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.430934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311862bd-c266-488a-bae7-c77d859f935d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.431146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17155c6-01f4-4517-acff-9bb8251706f8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.466922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.467654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.468095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.468448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.468551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.469116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.469282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=2b3d7e7911f04fa58b010d84f61dc478) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:27.469388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.469664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.469845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:27.470809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:27.471623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:27.472256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:27.474008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 112/227] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:27.474802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.486893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 116/228] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/role_assignments?user.id=2b3d7e7911f04fa58b010d84f61dc478&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=63bab4de085f498f963ba60424cdcde1 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:27.488045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.539631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:27.590253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720c9204-4358-47ef-aaa7-328553957cdc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.602750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:27.632020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.632975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.634131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.635221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.647630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:27.653790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:27.654900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:27.655850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:27.658068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 113/229] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:27.665677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.729185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb47ccf-7b8a-4a3d-93d1-6bf10d192d19 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.772971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf463fe7-05b7-47bb-91b1-ec843e4f3afb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:27.803258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.804327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.804614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.804894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/33ec884ca5ea49fe8f6553fb38cabaf7/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.808069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=51d32dba71b34e72886cd24d0f55fdd2, user_id=33ec884ca5ea49fe8f6553fb38cabaf7, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:27.814732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:27.831026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 117/230] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:27 2022] PUT /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/33ec884ca5ea49fe8f6553fb38cabaf7/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:27.839484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:27.840118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:27.840400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:27.840718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:27.841414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:27.841766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:27.843251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:27.853620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 114/231] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:27.859318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:27.972950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:27.989081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aef4b8-78eb-40e4-9381-cfeddb37c7a1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:28.033875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:28.034519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:28.034909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:28.035192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] PATH_INFO: `/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:28.037834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] RBAC: Authorizing `identity:get_user(user_id=33ec884ca5ea49fe8f6553fb38cabaf7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:28.039354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:28.041126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 118/232] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:27 2022] GET /identity/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7 => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:28.046861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:28.082712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:28.163021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad98066-f8be-45fa-82dd-a3ea257c33e8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:28.206994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7be009f-a3a6-4335-be71-f5960a096654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:28.207638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be009f-a3a6-4335-be71-f5960a096654 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:28.207926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be009f-a3a6-4335-be71-f5960a096654 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:28.208205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7be009f-a3a6-4335-be71-f5960a096654 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:28.212130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be009f-a3a6-4335-be71-f5960a096654 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:28.213596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7be009f-a3a6-4335-be71-f5960a096654 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:28.215465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 115/233] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:28 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:28.220965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:28.347697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5696ad-c107-4203-8c38-69a697ae36c1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:28.383232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22f6b66-c749-4664-bc82-ec65ed4c0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:28.384466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6b66-c749-4664-bc82-ec65ed4c0709 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:28.384752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6b66-c749-4664-bc82-ec65ed4c0709 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:28.385026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22f6b66-c749-4664-bc82-ec65ed4c0709 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/33ec884ca5ea49fe8f6553fb38cabaf7/roles/8c530229735042e8958733424a56358b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:28.387269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f6b66-c749-4664-bc82-ec65ed4c0709 None admin] RBAC: Authorizing `identity:create_grant(project_id=51d32dba71b34e72886cd24d0f55fdd2, user_id=33ec884ca5ea49fe8f6553fb38cabaf7, role_id=8c530229735042e8958733424a56358b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:28.388778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22f6b66-c749-4664-bc82-ec65ed4c0709 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:28.406204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 119/234] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:28 2022] PUT /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/33ec884ca5ea49fe8f6553fb38cabaf7/roles/8c530229735042e8958733424a56358b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:28.973057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd64f-e8ed-4a77-b327-6d2ce2a838b9 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:28.973600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd64f-e8ed-4a77-b327-6d2ce2a838b9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:28.973600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3fd64f-e8ed-4a77-b327-6d2ce2a838b9 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:28.975128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 116/235] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:28.980821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:28.981658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:28.982135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.011290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:29.011977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e76ac-908f-47aa-b1da-84502940d498 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:29.012260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e76ac-908f-47aa-b1da-84502940d498 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:29.012534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599e76ac-908f-47aa-b1da-84502940d498 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.013462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:29.014123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 117/236] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:29.018930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:29.019276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:29.019558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.032717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:29.040930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:29.042113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:29.114963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 118/237] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:29.134042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 120/238] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:29.448411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:29.478845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:29.558675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:29.564383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8c7c9-70da-4ebb-8566-1c7483f3f014 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:29.604188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:29.605342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:29.605826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:29.606328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.619163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:29.624926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:29.625807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:29.626622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:29.629392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 119/239] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:29.639640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:29.734398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debdf4cf-f5b1-4bb3-b22e-6ab1f907a49d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:29.764044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:29.792628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:29.793624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:29.794136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:29.794611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.796099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:29.796872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f6a0a3-ee4f-4c23-a54d-5a78d9680e13 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:29.797966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:29.800281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 121/240] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:29.813628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:29.851668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:29.852322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:29.852605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:29.852879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.853561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] RBAC: Adding query filter params (name=reader) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:29.853862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:29.855289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6342177a-2508-4541-852f-1bda784fe819 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:29.856302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:29.872225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 120/241] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:29.873522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd70eda-58c5-4c69-bffe-86fa0096ef7f None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:29.873815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd70eda-58c5-4c69-bffe-86fa0096ef7f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:29.874096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd70eda-58c5-4c69-bffe-86fa0096ef7f None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:29.875804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 121/242] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:29.879719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd70eda-58c5-4c69-bffe-86fa0096ef7f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:29.971929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b2527-4f54-47ee-bf18-fd401101d56b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:30.002874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd70eda-58c5-4c69-bffe-86fa0096ef7f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:30.017573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb9adf2-a1b4-46dd-9d2c-044c2bbc9063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:30.018789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9adf2-a1b4-46dd-9d2c-044c2bbc9063 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.019244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9adf2-a1b4-46dd-9d2c-044c2bbc9063 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.019715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb9adf2-a1b4-46dd-9d2c-044c2bbc9063 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.020526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9adf2-a1b4-46dd-9d2c-044c2bbc9063 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:30.022188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb9adf2-a1b4-46dd-9d2c-044c2bbc9063 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:30.043850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:30.044774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.045393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.045855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] PATH_INFO: `/v3/users/64c1f5023a484913812e4ab4ab39dbc4` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.053382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 122/243] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:29 2022] POST /identity/v3/users => generated 293 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:13:30.053382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.053382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.053382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.075972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:30.076464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] RBAC: Authorizing `identity:get_user(user_id=64c1f5023a484913812e4ab4ab39dbc4)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:30.077408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:30.078306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:30.080220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 122/244] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:29 2022] GET /identity/v3/users/64c1f5023a484913812e4ab4ab39dbc4 => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:30.086107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:30.106730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:30.171430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 123/245] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:30.277239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547c1604-771e-4d58-85c7-e9a9be9f9437 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:30.314906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5328b99f-11f3-41d5-b815-8b9b8f3a550d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:30.315517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328b99f-11f3-41d5-b815-8b9b8f3a550d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.315794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328b99f-11f3-41d5-b815-8b9b8f3a550d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.316065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328b99f-11f3-41d5-b815-8b9b8f3a550d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.390981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328b99f-11f3-41d5-b815-8b9b8f3a550d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:30.392449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5328b99f-11f3-41d5-b815-8b9b8f3a550d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:30.405026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:30.511822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 123/246] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:13:30.518201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:30.520791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:30.528581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374740f-d5b7-4b4f-8095-996a46d4573e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.528919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374740f-d5b7-4b4f-8095-996a46d4573e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.529135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5374740f-d5b7-4b4f-8095-996a46d4573e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.531048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 124/247] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:30.537578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.537862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.538141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.557532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:30.558763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:30.652779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 125/248] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:30.654144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:30.663897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9ecbee-5ed2-499e-ac4a-5043ebd9b050 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:30.706053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:30.712530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:30.713580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.713867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.714144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.715586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:30.717571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:30.719785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 124/249] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:30 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:30.725292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:30.786455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f82c0-49fc-400b-a2f1-717caf2c1f72 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:30.813666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:30.836886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f6b55f-35c0-43de-b7d5-7e2d6a00405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:30.837544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b55f-35c0-43de-b7d5-7e2d6a00405e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.837822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b55f-35c0-43de-b7d5-7e2d6a00405e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.838092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f6b55f-35c0-43de-b7d5-7e2d6a00405e None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.856014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f6b55f-35c0-43de-b7d5-7e2d6a00405e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:30.860790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2951b2-fd78-4c9d-9c64-ade76ceeeb23 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-20f6b55f-35c0-43de-b7d5-7e2d6a00405e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:30.870877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:30.871818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:30.872617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:30.874268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 126/250] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:30.878465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eaaff-7dde-4a54-85c4-dae880163a90 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.878846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eaaff-7dde-4a54-85c4-dae880163a90 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.879029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815eaaff-7dde-4a54-85c4-dae880163a90 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.880486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 127/251] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:30.883140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eaaff-7dde-4a54-85c4-dae880163a90 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:30.918064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:30.918594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.918907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.919182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.919980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] RBAC: Adding query filter params (role.id=06e64363f6d940708ca457ba5bb23067, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=64c1f5023a484913812e4ab4ab39dbc4) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:30.920287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:30.921788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d69e68f-1b05-4bbe-9471-f9d523794f01 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:30.928440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 125/252] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:30 2022] GET /identity/v3/role_assignments?user.id=64c1f5023a484913812e4ab4ab39dbc4&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=06e64363f6d940708ca457ba5bb23067 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:30.929726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:30.930015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:30.934972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:30.968771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:30.969957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:31.080806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:31.088692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815eaaff-7dde-4a54-85c4-dae880163a90 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.117146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 126/253] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:31.121186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.149203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.150498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.151304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.151805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.152691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:31.153452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:31.159926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:31.174332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 128/254] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:31.182409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.249215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:31.295728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08414a30-06e7-4c91-97b7-f36644c52fe1 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.331723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.332848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.333358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.333831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.345757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:31.351357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:31.352462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:31.353440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:31.356053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 127/255] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:31.362172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.422348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d4460-50a9-413c-9eaf-ff1f3e7b77fc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.486431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.487044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.487330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.487609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] PATH_INFO: `/v3/users/2b3d7e7911f04fa58b010d84f61dc478` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.488766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d7e7911f04fa58b010d84f61dc478)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:31.490237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:31.491926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 129/256] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/users/2b3d7e7911f04fa58b010d84f61dc478 => generated 297 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:31.507753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.531051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dc0bac-63cd-4294-b429-1047dbb72575 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.559455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:31.569701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.570601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.571639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.572222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.573344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:31.573867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:31.575529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:31.578441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:31.590984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 128/257] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:31.592096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.704881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6c97b-8c65-40f3-9a50-6d6962a17629 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.743778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.745182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.745933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.746730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.762445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:31.771539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:31.772449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:31.773313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:31.774559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6e9647-9a35-45e5-81d4-505cc0f8f073 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.776755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 129/258] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:31.778203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.833642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:31.848307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.848953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.849235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.849510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.850636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:31.852708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:31.858728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 130/259] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:31.862008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:31.898250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82e9f1d-bffc-4df0-8cf7-a64a128aba3c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:31.992034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:31.993261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:31.993629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:31.993938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] PATH_INFO: `/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:31.999399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] RBAC: Authorizing `identity:get_user(user_id=33ec884ca5ea49fe8f6553fb38cabaf7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.000885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.002839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 130/260] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7 => generated 283 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:32.003617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.019173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e9e4ad-ec99-4ae5-9206-c08c72164b73 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:32.051790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:32.055628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:32.056190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:32.056482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:32.056767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:32.057448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:32.057756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.059324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.068224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 131/261] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:32.074265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.177134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a9c1b-5829-4156-89c1-fb7adc72275a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:32.213441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:32.214065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:32.214354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:32.214635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:32.243458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:32.250870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c906f51-85d8-4455-8ba5-ad0f5e091a4b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:32.271675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:32.298264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.298264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.324694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:32.325367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:32.325651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:32.325925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/2b3d7e7911f04fa58b010d84f61dc478/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:32.329544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] RBAC: Authorizing `identity:create_grant(project_id=51d32dba71b34e72886cd24d0f55fdd2, user_id=2b3d7e7911f04fa58b010d84f61dc478, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.331040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.351010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 131/262] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:32 2022] PUT /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/2b3d7e7911f04fa58b010d84f61dc478/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:32.352003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.475164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ce9d6-50f3-4105-9d0d-ccab37f3526b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:32.516536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:32.517104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:32.517397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:32.517677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] PATH_INFO: `/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:32.519814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] RBAC: Authorizing `identity:get_user(user_id=33ec884ca5ea49fe8f6553fb38cabaf7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.521625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.525521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 132/263] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:32 2022] GET /identity/v3/users/33ec884ca5ea49fe8f6553fb38cabaf7 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:32.531969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.558585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 132/264] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:32.564592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.589009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:32.676219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:32.679696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5098cb6-2a06-48c1-8abd-b6ad3b7827b0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:32.734648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:32.734648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:32.734648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:32.734648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:32.761692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b0fc66-3e9b-4689-a05e-c8324155bbdf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:32.806500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.808084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.819304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:32.820203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:32.820813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:32.821254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:32.823876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:32.825617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:32.827942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 133/265] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:32 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:32.834174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.853582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:32.914853 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 133/266] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:13:32.920417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:32.973006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64822cf6-6f0a-4298-b471-599e2425d449 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:33.002545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:33.013842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:33.014830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.015305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.015774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.016719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=33ec884ca5ea49fe8f6553fb38cabaf7) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:33.017176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:33.018994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:33.024571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60892898-6b26-49ce-a8ba-44043bcba8d1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:33.026333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 134/267] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:32 2022] GET /identity/v3/role_assignments?user.id=33ec884ca5ea49fe8f6553fb38cabaf7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:33.064038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd2cce-2494-4beb-b896-c074dbdc5417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:33.064783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd2cce-2494-4beb-b896-c074dbdc5417 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.065165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd2cce-2494-4beb-b896-c074dbdc5417 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.065535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd2cce-2494-4beb-b896-c074dbdc5417 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.066869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd2cce-2494-4beb-b896-c074dbdc5417 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:33.068428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fd2cce-2494-4beb-b896-c074dbdc5417 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:33.070182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 134/268] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:32 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:33.079892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:33.111515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946670-f8ad-45df-aa8f-e5b36c7086e1 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.111886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946670-f8ad-45df-aa8f-e5b36c7086e1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.112272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe946670-f8ad-45df-aa8f-e5b36c7086e1 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.113698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 135/269] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:33.119697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d0f7-afda-4bd5-95c6-3dcc111dc352 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.119993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d0f7-afda-4bd5-95c6-3dcc111dc352 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.120409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962d0f7-afda-4bd5-95c6-3dcc111dc352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.151953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9962d0f7-afda-4bd5-95c6-3dcc111dc352 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:33.158727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9962d0f7-afda-4bd5-95c6-3dcc111dc352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:33.162046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:33.254851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 136/270] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:33.297467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa77ed-c60a-4e3f-bf8e-f173fa59b7d7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:33.356110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:33.356964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.357412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.357835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.358739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] RBAC: Adding query filter params (role.id=8c530229735042e8958733424a56358b, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=33ec884ca5ea49fe8f6553fb38cabaf7) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:33.359204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:33.360818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d195456-3858-4907-ac8b-be31a71ab7ba None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:33.369955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 135/271] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:33 2022] GET /identity/v3/role_assignments?user.id=33ec884ca5ea49fe8f6553fb38cabaf7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=8c530229735042e8958733424a56358b => generated 608 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:33.529466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e95e0-43c9-45f5-81ac-f1f3ae8e4a51 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.529756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e95e0-43c9-45f5-81ac-f1f3ae8e4a51 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.530038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e95e0-43c9-45f5-81ac-f1f3ae8e4a51 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.531706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 137/272] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:33.536963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08200-d0e3-4eec-b702-689f4953fbfe None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.537520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08200-d0e3-4eec-b702-689f4953fbfe None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.537999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c08200-d0e3-4eec-b702-689f4953fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.560620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-79c08200-d0e3-4eec-b702-689f4953fbfe None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:33.561816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-79c08200-d0e3-4eec-b702-689f4953fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:33.573401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e95e0-43c9-45f5-81ac-f1f3ae8e4a51 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:33.646692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:33.668643 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 136/273] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 17 23:13:33.726442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e95e0-43c9-45f5-81ac-f1f3ae8e4a51 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:33.763998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:33.765034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.765535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.766000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.775755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:33.780213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:33.785334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:33.786425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:33.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:33.791213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 138/274] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:33.797291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02beb6-94b9-451c-8fad-35a139190651 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.797594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02beb6-94b9-451c-8fad-35a139190651 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.797867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02beb6-94b9-451c-8fad-35a139190651 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.798262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:33.799245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 137/275] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:33.804338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.804625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.805604 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.824982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:33.826303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:33.909615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ad4b72-3854-4083-89a8-a22bba27fba5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:33.914542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 138/276] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:33.949166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:33.949785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:33.950065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:33.950336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:33.951041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:33.951342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:33.952795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:33.962638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 139/277] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:33.968267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:33.985533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.067472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:34.092085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a798fea8-ec74-4476-9a82-643ce25db854 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.111197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:34.118572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c22465-276c-49c2-8959-eee24b135b2d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.139399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.140698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.141135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.141558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] PATH_INFO: `/v3/users/e85cd4bc0971479e8f6a9ef51e3c9c97` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.162339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] RBAC: Authorizing `identity:get_user(user_id=e85cd4bc0971479e8f6a9ef51e3c9c97)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:34.162925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.163566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.163846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.164165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.165525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:34.166224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:34.168112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:34.168336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 139/278] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:33 2022] GET /identity/v3/users/e85cd4bc0971479e8f6a9ef51e3c9c97 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:34.174082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 140/279] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:34.175127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.175306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.295352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968afabc-908c-44f9-b90c-58c5932112f0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.302083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a9474e-9d9b-4aed-9c5b-30284dd000c1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.325235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:34.332248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.332859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.333142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.333447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.334082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:34.335565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:34.342636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.343423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.343846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.344283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.345149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, user.id=e85cd4bc0971479e8f6a9ef51e3c9c97, scope.system=all) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:34.345593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:34.347263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:34.354905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 140/280] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 17 23:13:34 2022] GET /identity/v3/role_assignments?user.id=e85cd4bc0971479e8f6a9ef51e3c9c97&scope.system=all&role.id=63bab4de085f498f963ba60424cdcde1 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:34.354905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.372619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 141/281] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:13:34 2022] POST /identity/v3/users => generated 293 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:34.409711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:34.494384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5821739-3df7-4204-9a6e-1f514ae35d82 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.535094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.535729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.536016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.536281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.547801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:34.552639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:34.553511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:34.554432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 141/282] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:34.563312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.674904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7cabb-6bb8-4d4b-91eb-0df3c942ba67 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.712635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.713638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.714122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.714595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.715491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:34.715994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:34.717611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:34.729298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 142/283] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:34.735285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.846504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:34.856883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda90a09-f5d3-4193-b231-544f50a491ae None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:34.905064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e90ce8-e116-4ef0-a16b-6d80e28d18d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:34.905714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90ce8-e116-4ef0-a16b-6d80e28d18d2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:34.906000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90ce8-e116-4ef0-a16b-6d80e28d18d2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:34.906282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90ce8-e116-4ef0-a16b-6d80e28d18d2 None admin] PATH_INFO: `/v3/users/64c1f5023a484913812e4ab4ab39dbc4` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:34.907470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e90ce8-e116-4ef0-a16b-6d80e28d18d2 None admin] RBAC: Authorizing `identity:get_user(user_id=64c1f5023a484913812e4ab4ab39dbc4)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:34.908923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e90ce8-e116-4ef0-a16b-6d80e28d18d2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:34.910517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 142/284] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:34 2022] GET /identity/v3/users/64c1f5023a484913812e4ab4ab39dbc4 => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:34.916425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:34.997222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:35.070943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faffca8f-344e-48e0-81df-876783c8ff77 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:35.089919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5a4a-de2f-444e-b1d3-30c700483210 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:35.090245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5a4a-de2f-444e-b1d3-30c700483210 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:35.090483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c5a4a-de2f-444e-b1d3-30c700483210 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:35.092096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 143/285] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:35.097093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:35.097320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:35.097603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:35.126950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:35.127650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:35.127933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:35.128252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:35.129681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:35.130901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:35.134214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:35.135722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:35.137423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 143/286] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:34 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:35.143127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:35.245918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 144/287] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:35.303894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1252408c-3a2e-41ce-ac1f-4d1b9ea093d7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:35.321612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:35.348415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:35.349005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:35.349292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:35.349571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/64c1f5023a484913812e4ab4ab39dbc4/roles/06e64363f6d940708ca457ba5bb23067` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:35.351523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] RBAC: Authorizing `identity:create_grant(project_id=51d32dba71b34e72886cd24d0f55fdd2, user_id=64c1f5023a484913812e4ab4ab39dbc4, role_id=06e64363f6d940708ca457ba5bb23067)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:35.353284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:35.375020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 144/288] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:13:35 2022] PUT /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/users/64c1f5023a484913812e4ab4ab39dbc4/roles/06e64363f6d940708ca457ba5bb23067 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:13:35.563874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:35.673881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:35.681363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e7db10-4f2d-41f2-997b-9f0f31af0847 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:35.718594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:35.719315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:35.719603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:35.719880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:35.730900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:35.735589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:35.736448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:35.737306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 145/289] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:35.743008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:35.855730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a903e2-7567-46c3-becb-dd31b3e7add5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:35.902310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:35.903219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:35.903505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:35.903777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:35.904458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:35.904763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:35.906292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:35.918825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 145/290] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:35.921486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:36.075840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6faa0d4-f80e-4f87-bded-aad02e1302c1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:36.128443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:36.129085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.129366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.129640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] PATH_INFO: `/v3/users/2b3d7e7911f04fa58b010d84f61dc478` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.130795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] RBAC: Authorizing `identity:get_user(user_id=2b3d7e7911f04fa58b010d84f61dc478)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:36.132237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:36.134294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 146/291] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:35 2022] GET /identity/v3/users/2b3d7e7911f04fa58b010d84f61dc478 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:36.140097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:36.200250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:36.279977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d4f26-3068-4a27-9cee-9f4c80cb263e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:36.334258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ea7941-c163-4a05-93e8-8ba71ade647b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:36.334897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7941-c163-4a05-93e8-8ba71ade647b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.335110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7941-c163-4a05-93e8-8ba71ade647b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.335370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ea7941-c163-4a05-93e8-8ba71ade647b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.420428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea7941-c163-4a05-93e8-8ba71ade647b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:36.421902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ea7941-c163-4a05-93e8-8ba71ade647b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:36.461424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:36.531910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 146/292] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:36.537748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:36.576572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093b7c-5b09-4a25-be85-c6461c5e6f63 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.576874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093b7c-5b09-4a25-be85-c6461c5e6f63 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.577131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01093b7c-5b09-4a25-be85-c6461c5e6f63 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.578736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 147/293] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:36.584075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.584425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.584751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.590404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:36.606665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:36.608012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:36.745515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 148/294] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:36.755461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dcaa9-89ab-4b1b-8387-0021b0e19e9d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:36.824138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2279e8fd-8ee4-4e7b-a7bb-ea175040de28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:36.824802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279e8fd-8ee4-4e7b-a7bb-ea175040de28 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.825081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279e8fd-8ee4-4e7b-a7bb-ea175040de28 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.825349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2279e8fd-8ee4-4e7b-a7bb-ea175040de28 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.826482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279e8fd-8ee4-4e7b-a7bb-ea175040de28 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:36.827956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2279e8fd-8ee4-4e7b-a7bb-ea175040de28 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:36.829879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 147/295] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:36 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:36.835819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:36.843897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc374d-ae5e-4a74-b5c1-c395a6084a03 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.844187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc374d-ae5e-4a74-b5c1-c395a6084a03 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.844465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dc374d-ae5e-4a74-b5c1-c395a6084a03 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.845990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 148/296] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:36.850714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:36.851004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:36.851280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:36.879729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:36.880922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:36.963296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:36.995881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 149/297] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:37.022671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e27668-0c95-436e-87ee-bee21a5965e7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.058120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.058760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.059050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.059326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.060062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=2b3d7e7911f04fa58b010d84f61dc478) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:37.060372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:37.061884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b560af-d03e-4f06-9a7f-ce9385e53872 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:37.067761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 149/298] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:36 2022] GET /identity/v3/role_assignments?user.id=2b3d7e7911f04fa58b010d84f61dc478&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=63bab4de085f498f963ba60424cdcde1 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:37.081683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.120815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.170225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd21f-0901-4257-a896-049e211082eb None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.170537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd21f-0901-4257-a896-049e211082eb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.170816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97dd21f-0901-4257-a896-049e211082eb None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.172365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 150/299] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:37.180238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.180563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.181051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.215087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:37.216279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:37.230382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e478e-1570-487c-b51c-53c898514c53 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.273232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.273949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.274234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.274509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.290995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:37.296484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:37.297382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:37.298187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 150/300] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:37.306903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.323309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 151/301] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:37.343016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.405310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.427176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec71813-6d6c-4d2d-9faf-039f6a49a4fe None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.427346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.463100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.463713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.463995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.464270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.464943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:37.465244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:37.466680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:37.471584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba90838-ff16-4386-904a-befa000e6797 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.475601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 151/302] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:37.481595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.512551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.513210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.513591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.513885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.526147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:37.531146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:37.532025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:37.532802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 152/303] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:37.541123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.596388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed149ecf-80f9-4b5d-91af-090a39276d0c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.631532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.632282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.632570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.633557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] PATH_INFO: `/v3/users/e85cd4bc0971479e8f6a9ef51e3c9c97` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.634847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] RBAC: Authorizing `identity:get_user(user_id=e85cd4bc0971479e8f6a9ef51e3c9c97)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:37.636299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:37.638237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 152/304] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/users/e85cd4bc0971479e8f6a9ef51e3c9c97 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:37.643689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.650940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d3e1b7-549e-44fd-8e08-2ba962ecd2a7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.657747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.677830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.691468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.692082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.692362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.692643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.693309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] RBAC: Adding query filter params (name=reader) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:37.693612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:37.695024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:37.707764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 153/305] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:37.707764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.759062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5886a3-9eae-4118-8ef8-bb25d77be81d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.798525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.799458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.800018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.800564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] PATH_INFO: `/v3/system/users/e85cd4bc0971479e8f6a9ef51e3c9c97/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.801956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=e85cd4bc0971479e8f6a9ef51e3c9c97, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:37.803591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:37.810352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2468ebc-7fd7-4f12-8a04-41d7d5b4886b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.822848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 153/306] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Aug 17 23:13:37 2022] PUT /identity/v3/system/users/e85cd4bc0971479e8f6a9ef51e3c9c97/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:13:37.822848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.857026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.857803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.858085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.858362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:37.859556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:37.861278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:37.863278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 154/307] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:37.871733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:37.919283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.934397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:37.951963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77361364-acb6-4be9-af82-d23c7472cb03 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.990596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea58642-3549-4b47-97d3-7914f5026b6c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:37.994114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:37.994808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:37.995095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:37.995371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] PATH_INFO: `/v3/users/d154c92d1a4f4aa99a036e858a7a109b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.010834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] RBAC: Authorizing `identity:get_user(user_id=d154c92d1a4f4aa99a036e858a7a109b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:38.012328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:38.014094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 154/308] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:37 2022] GET /identity/v3/users/d154c92d1a4f4aa99a036e858a7a109b => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:38.019900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:38.030797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a4ed6c-5aa4-44f4-a789-9dbdf056c3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:38.031505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ed6c-5aa4-44f4-a789-9dbdf056c3c3 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.031868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ed6c-5aa4-44f4-a789-9dbdf056c3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.032242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a4ed6c-5aa4-44f4-a789-9dbdf056c3c3 None admin] PATH_INFO: `/v3/groups` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.032940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4ed6c-5aa4-44f4-a789-9dbdf056c3c3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:38.034470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a4ed6c-5aa4-44f4-a789-9dbdf056c3c3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:38.053579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 155/309] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Aug 17 23:13:37 2022] POST /identity/v3/groups => generated 229 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:38.097038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159e153-edfb-4830-ac3c-d8c9d39e2ad6 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.097334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159e153-edfb-4830-ac3c-d8c9d39e2ad6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.097622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3159e153-edfb-4830-ac3c-d8c9d39e2ad6 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.103965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 156/310] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:38.105766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.106133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.106485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.126297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:38.127647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:38.137136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf4ecc5-67d5-446a-9ef7-b5c4bcf425fe None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:38.176896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:38.184476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:38.185473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.185927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.186370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.187363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] RBAC: Adding query filter params (role.id=06e64363f6d940708ca457ba5bb23067, user.id=d154c92d1a4f4aa99a036e858a7a109b, scope.system=all) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:38.187885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:38.189710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:38.202888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 155/311] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 17 23:13:38 2022] GET /identity/v3/role_assignments?user.id=d154c92d1a4f4aa99a036e858a7a109b&scope.system=all&role.id=06e64363f6d940708ca457ba5bb23067 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:38.222645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 157/312] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:38.504200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:38.615536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a9d058-8fcb-40e1-bbe9-eb47b8f0d0fe None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:38.652199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:38.653095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.653378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.653655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.664932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:38.669880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:38.670761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:38.671586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:38.674823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 156/313] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:38.677213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:38.720614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:38.782286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c177bb-0baa-4048-9227-ee20065c69ac None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:38.818009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:38.818622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.818928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.819203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.819879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:38.820708 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:38.822492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:38.831185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 158/314] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:38.836680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:38.897015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:38.943312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316ef5e7-aa40-435f-92b9-2abfeb9af6fb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:38.981656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:38.982290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:38.982576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:38.983119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] PATH_INFO: `/v3/users/64c1f5023a484913812e4ab4ab39dbc4` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:38.984001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] RBAC: Authorizing `identity:get_user(user_id=64c1f5023a484913812e4ab4ab39dbc4)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:38.985455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:38.990829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 157/315] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:38 2022] GET /identity/v3/users/64c1f5023a484913812e4ab4ab39dbc4 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:38.995884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:39.105593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918f045b-df3c-4cb5-82e2-e12ae29e8ad2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:39.108016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:39.140756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:39.141436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:39.141719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:39.141993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:39.211274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:39.213378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:39.321716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 159/316] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:39.327595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:39.447319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9ba0f3-a014-46f1-a644-97c0bae064f1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:39.476365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:39.488323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a119071c-9966-461b-bf2a-822efd8f885a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:39.489273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119071c-9966-461b-bf2a-822efd8f885a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:39.489695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119071c-9966-461b-bf2a-822efd8f885a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:39.490135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a119071c-9966-461b-bf2a-822efd8f885a None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:39.491429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119071c-9966-461b-bf2a-822efd8f885a None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:39.493217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a119071c-9966-461b-bf2a-822efd8f885a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:39.495391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 158/317] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:39 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:39.506734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:39.506734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:39.607774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6c011-d46f-44ed-8964-fbff6eeac014 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:39.646125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:39.646773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:39.647058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:39.647333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:39.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] RBAC: Adding query filter params (role.id=06e64363f6d940708ca457ba5bb23067, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2, user.id=64c1f5023a484913812e4ab4ab39dbc4) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:39.648544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:39.650372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e84a98-00ea-4b61-9683-574da000890c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:39.657512 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 160/318] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:13:39 2022] GET /identity/v3/role_assignments?user.id=64c1f5023a484913812e4ab4ab39dbc4&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=06e64363f6d940708ca457ba5bb23067 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:39.887968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba74aca-c0fd-4f41-94fd-6ad5bba2f049 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:39.888978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba74aca-c0fd-4f41-94fd-6ad5bba2f049 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:39.889462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba74aca-c0fd-4f41-94fd-6ad5bba2f049 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:39.891283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 159/319] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:39.896796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7cc4c-22d5-4a17-90e2-79eb20d2f209 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:39.897203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7cc4c-22d5-4a17-90e2-79eb20d2f209 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:39.897341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee7cc4c-22d5-4a17-90e2-79eb20d2f209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:39.918252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-5ee7cc4c-22d5-4a17-90e2-79eb20d2f209 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:39.919889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5ee7cc4c-22d5-4a17-90e2-79eb20d2f209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:39.988802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:39.998730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 161/320] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:40.079549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f8890-9573-47cf-9e97-b4b806216a98 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.079849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f8890-9573-47cf-9e97-b4b806216a98 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.080104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f8890-9573-47cf-9e97-b4b806216a98 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.081595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 160/321] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:40.086811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d767a-f485-4bd8-8310-e87e9a1173e7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.087114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d767a-f485-4bd8-8310-e87e9a1173e7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.087399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4d767a-f485-4bd8-8310-e87e9a1173e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.106266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9b4d767a-f485-4bd8-8310-e87e9a1173e7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:40.107497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9b4d767a-f485-4bd8-8310-e87e9a1173e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:40.178138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 162/322] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:40.253081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662129b2-ed1b-40b3-8367-ea2258097d05 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.253418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662129b2-ed1b-40b3-8367-ea2258097d05 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.253640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662129b2-ed1b-40b3-8367-ea2258097d05 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.255138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 161/323] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:40.260505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.260806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.261092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.276062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662129b2-ed1b-40b3-8367-ea2258097d05 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.280864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:40.282059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:40.354870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 163/324] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:40.387668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662129b2-ed1b-40b3-8367-ea2258097d05 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.422348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.423007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.423292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.423566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.434006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:40.439117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:40.439991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:40.443606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 162/325] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:40.446896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.455985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.510939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:40.513213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:40.555156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea925d-d578-4365-816d-f1770c373a96 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.563640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acda594-3d9f-4eee-aece-87d4c05cf520 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.591714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.592330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.592616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.592894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.593567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:40.593875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:40.595284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:40.600055 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.600755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.601037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.601452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.602608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:40.604075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:40.606741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 163/326] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:40.609591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 164/327] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:40.610452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.611184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.711856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdab0e-8a11-4d96-b732-b7aaada952bd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.717172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e7d9c-18ce-4ee0-8567-bff2dd7aa58b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.730905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:40.736447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:40.746255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.746915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.747202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.747478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] PATH_INFO: `/v3/users/e85cd4bc0971479e8f6a9ef51e3c9c97` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.748588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] RBAC: Authorizing `identity:get_user(user_id=e85cd4bc0971479e8f6a9ef51e3c9c97)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:40.750022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:40.750797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.751407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.751662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 164/328] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/users/e85cd4bc0971479e8f6a9ef51e3c9c97 => generated 293 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:40.751747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.751956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] PATH_INFO: `/v3/groups` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.752431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.752587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:40.753995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:40.769116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 165/329] 10.222.0.39 () {60 vars in 1134 bytes} [Wed Aug 17 23:13:40 2022] POST /identity/v3/groups => generated 226 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:13:40.769958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:40.881598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c9b275-f32f-471d-8773-91752d517b42 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.883016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc02989-1b8a-4e7c-9e23-b778d295b47e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:40.920371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.920993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.921280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.922910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.922910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] RBAC: Adding query filter params (role.id=63bab4de085f498f963ba60424cdcde1, user.id=e85cd4bc0971479e8f6a9ef51e3c9c97, scope.system=all) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:40.922910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:40.923429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:40.924070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:40.924167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:40.924358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:40.924633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:40.938995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:40.946730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 166/330] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/role_assignments?user.id=e85cd4bc0971479e8f6a9ef51e3c9c97&scope.system=all&role.id=63bab4de085f498f963ba60424cdcde1 => generated 510 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:40.946922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:40.947956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:40.948918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 165/331] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:40.953194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:41.002386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:41.089777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b30f1d9-0bc6-48a8-a5fc-1da512854fc5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:41.129777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:41.130401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:41.130689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:41.130995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:41.131734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] RBAC: Adding query filter params (name=reader) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:41.131994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:41.134045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:41.143078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 167/332] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:40 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:41.148651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:41.204172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:41.263921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c1f8-925e-48e9-ab64-ba5709668725 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:41.300929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5fe5a4-03dc-45b7-b321-78b6436fbf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:41.301571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fe5a4-03dc-45b7-b321-78b6436fbf80 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:41.301856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fe5a4-03dc-45b7-b321-78b6436fbf80 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:41.302132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5fe5a4-03dc-45b7-b321-78b6436fbf80 None admin] PATH_INFO: `/v3/users/d154c92d1a4f4aa99a036e858a7a109b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:41.303308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fe5a4-03dc-45b7-b321-78b6436fbf80 None admin] RBAC: Authorizing `identity:get_user(user_id=d154c92d1a4f4aa99a036e858a7a109b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:41.305471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5fe5a4-03dc-45b7-b321-78b6436fbf80 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:41.307376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 166/333] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:41 2022] GET /identity/v3/users/d154c92d1a4f4aa99a036e858a7a109b => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:41.313242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:41.427014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:41.430272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b82da-6f79-4c5f-821d-f1191b656964 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:41.466552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7196907f-9e02-47ce-a844-ba7b766f7ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:41.467450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196907f-9e02-47ce-a844-ba7b766f7ec8 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:41.467732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196907f-9e02-47ce-a844-ba7b766f7ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:41.468007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7196907f-9e02-47ce-a844-ba7b766f7ec8 None admin] PATH_INFO: `/v3/system/users/d154c92d1a4f4aa99a036e858a7a109b/roles/06e64363f6d940708ca457ba5bb23067` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:41.469425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196907f-9e02-47ce-a844-ba7b766f7ec8 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d154c92d1a4f4aa99a036e858a7a109b, role_id=06e64363f6d940708ca457ba5bb23067)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:41.470835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7196907f-9e02-47ce-a844-ba7b766f7ec8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:41.484925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 168/334] 10.222.0.39 () {58 vars in 1334 bytes} [Wed Aug 17 23:13:41 2022] PUT /identity/v3/system/users/d154c92d1a4f4aa99a036e858a7a109b/roles/06e64363f6d940708ca457ba5bb23067 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:43.042347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1d92-840a-402e-bdda-a21bd97f0be4 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.042929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1d92-840a-402e-bdda-a21bd97f0be4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.042929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d1d92-840a-402e-bdda-a21bd97f0be4 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.044412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 167/335] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:43.060649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ff084-fb77-4406-bd0f-d7dd95f0135a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.061152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ff084-fb77-4406-bd0f-d7dd95f0135a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.061231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ff084-fb77-4406-bd0f-d7dd95f0135a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.087715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-359ff084-fb77-4406-bd0f-d7dd95f0135a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:43.088921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-359ff084-fb77-4406-bd0f-d7dd95f0135a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:43.179652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 169/336] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:43.208374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b48a-41f5-4ee2-8838-e50e6b067ac4 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.208686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b48a-41f5-4ee2-8838-e50e6b067ac4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.208962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b48a-41f5-4ee2-8838-e50e6b067ac4 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.210336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 168/337] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:43.216321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a0b7-8c06-400a-9e56-246fc344f92e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.216897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a0b7-8c06-400a-9e56-246fc344f92e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.217388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b1a0b7-8c06-400a-9e56-246fc344f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.238869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-49b1a0b7-8c06-400a-9e56-246fc344f92e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:43.240385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-49b1a0b7-8c06-400a-9e56-246fc344f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:43.344854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 170/338] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:43.380906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53199f0e-7c78-4698-bdf6-fefb8e8291a5 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.381185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53199f0e-7c78-4698-bdf6-fefb8e8291a5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.381651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53199f0e-7c78-4698-bdf6-fefb8e8291a5 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.383954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 169/339] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:43.389008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.389304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.389583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.416437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:43.417627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:43.439156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:43.498788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 171/340] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:43.595967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53199f0e-7c78-4698-bdf6-fefb8e8291a5 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:43.736272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53199f0e-7c78-4698-bdf6-fefb8e8291a5 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:43.758533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:43.760780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:43.787728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:43.788367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:43.789307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:43.789665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:43.820044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:43.826415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:43.827309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:43.828115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 170/341] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:43.837575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:43.981059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4973503-bce2-4a3e-9b11-7eeb00ce8441 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.047317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.047964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.048243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.048514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.049602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf1911c-17d2-49ff-a026-687622564162 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.069263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:44.076910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:44.077820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:44.078601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:44.082636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 172/342] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:44.083488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:44.109833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.110461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.110762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.111042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.111724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:44.112028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:44.113717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:44.115394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.133699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 171/343] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:44.135525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:44.223291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.235343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a0de4b-7c4d-4154-bb15-bba3680d3e6a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.277883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.277883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.277883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.277883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.290726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:44.301936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:44.302918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:44.303825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:44.305587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 173/344] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:44.307248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:44.362095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91743097-1e09-4066-b30f-afe5d7208af0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.438861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.439485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.439772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.440051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.440727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:44.441037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:44.442442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:44.449908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.470155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 172/345] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:44.471059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:44.482793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24033f9-2613-44c7-86fb-f89b91136ac4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.521638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a9bb5-e81a-4f63-88e6-48d68be8f34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.522284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a9bb5-e81a-4f63-88e6-48d68be8f34f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.522566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a9bb5-e81a-4f63-88e6-48d68be8f34f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.523434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a9bb5-e81a-4f63-88e6-48d68be8f34f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.599763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a9bb5-e81a-4f63-88e6-48d68be8f34f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:44.601387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a9bb5-e81a-4f63-88e6-48d68be8f34f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:44.646799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.650589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27e8fe-3b77-4b82-9378-dc31825f74e0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.689138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.689758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.690038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.690308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.691024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:44.691319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:44.692802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:44.695917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.704838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 173/346] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:44.705541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:44.730173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 174/347] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:44.731998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e41e0-37d9-4992-970c-631356534f17 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.732301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e41e0-37d9-4992-970c-631356534f17 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.732585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245e41e0-37d9-4992-970c-631356534f17 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.734263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 175/348] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:44.735008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e41e0-37d9-4992-970c-631356534f17 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:44.849366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b17ab4-43ab-4e78-9841-13021fcbf3cf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.869923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245e41e0-37d9-4992-970c-631356534f17 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:44.889391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.890203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.890651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.890967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.918020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53e948-2004-4143-8fa7-2652daa85701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:44.919375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e948-2004-4143-8fa7-2652daa85701 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:44.920047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e948-2004-4143-8fa7-2652daa85701 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:44.920472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53e948-2004-4143-8fa7-2652daa85701 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:44.927039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.982237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:44.982425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:44.984878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.017756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53e948-2004-4143-8fa7-2652daa85701 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.019768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53e948-2004-4143-8fa7-2652daa85701 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.108198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 174/349] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:45.108198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.142466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 176/350] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:45.144811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f39c-4ad3-485c-bf08-bc9029dd1c1a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.145205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f39c-4ad3-485c-bf08-bc9029dd1c1a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.145591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d7f39c-4ad3-485c-bf08-bc9029dd1c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.167769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-82d7f39c-4ad3-485c-bf08-bc9029dd1c1a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:45.169013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-82d7f39c-4ad3-485c-bf08-bc9029dd1c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:45.188593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:45.245396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9966f2dd-497f-475a-aa1e-8e31ee752364 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.261570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 177/351] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:45.263013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186c71c-8506-45f8-87c1-02df31f19c8f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.263306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186c71c-8506-45f8-87c1-02df31f19c8f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.263591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b186c71c-8506-45f8-87c1-02df31f19c8f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.269085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 178/352] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:45.269991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186c71c-8506-45f8-87c1-02df31f19c8f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.275642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:45.295339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.296230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.296688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.297137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.298441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.300105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.301936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 175/353] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:45.302982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.407246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b186c71c-8506-45f8-87c1-02df31f19c8f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.429677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6009dd-1585-4199-babb-fb6856fab97d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.449070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef890a-22cd-4ffe-ad12-68c5387e7935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.449967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef890a-22cd-4ffe-ad12-68c5387e7935 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.450381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef890a-22cd-4ffe-ad12-68c5387e7935 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.450932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef890a-22cd-4ffe-ad12-68c5387e7935 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.452197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef890a-22cd-4ffe-ad12-68c5387e7935 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.453860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbef890a-22cd-4ffe-ad12-68c5387e7935 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.457055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 179/354] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:45.458439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef460-3ec1-465a-b385-e5fa3d769636 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.458961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef460-3ec1-465a-b385-e5fa3d769636 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.459430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbef460-3ec1-465a-b385-e5fa3d769636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.465126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:45.472638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.472638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.472638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.472638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.474234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.476517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.478381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 176/355] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:45.486020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.486167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cbbef460-3ec1-465a-b385-e5fa3d769636 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:45.486167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cbbef460-3ec1-465a-b385-e5fa3d769636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:45.568479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 180/356] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:45.569619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d117-f9c7-41cc-8b3d-76b40a91180d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.570440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d117-f9c7-41cc-8b3d-76b40a91180d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.570968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337d117-f9c7-41cc-8b3d-76b40a91180d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.572379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 181/357] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:45.573082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d117-f9c7-41cc-8b3d-76b40a91180d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.576001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:45.604560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f5a2c-0f9c-4d61-ae9e-a1ea3f950094 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.648159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.649052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.649334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.649607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.657044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.658558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.662494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 177/358] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:45.663313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.705425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337d117-f9c7-41cc-8b3d-76b40a91180d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.738250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:45.754528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.755518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.755952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.756437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.757803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.760547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.762396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 182/359] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:45.763616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.786045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf92a98-064a-436f-8d9f-ff35efb57208 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.829369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d90fe-ee32-4702-bbdd-925709d3815b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d90fe-ee32-4702-bbdd-925709d3815b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.830302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d90fe-ee32-4702-bbdd-925709d3815b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.830574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d90fe-ee32-4702-bbdd-925709d3815b None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.831788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d90fe-ee32-4702-bbdd-925709d3815b None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:45.833332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042d90fe-ee32-4702-bbdd-925709d3815b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:45.834965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 178/360] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:45.837171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.837466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.837727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.855151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:45.859990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:45.861257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:45.895592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7a7994-1e12-4065-b51b-9e69d25ba518 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:45.937354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:45.937909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:45.938232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:45.938500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:45.948667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 179/361] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:45.949531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:45.956802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:45.965992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:45.967040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:45.967862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 183/362] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:45.968520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.020668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:46.076606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddc5d1-527f-40e3-9de2-2ad1bc53c3ea None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.104366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61aa28c-218d-48fe-bceb-2c2a7a030e6f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.113043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.114226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.114686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.115156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.116056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:46.116613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:46.118306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:46.126029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 180/363] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=63bab4de085f498f963ba60424cdcde1 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:46.127114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.135951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:46.143666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.144490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.144871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.145239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.146099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=8c530229735042e8958733424a56358b, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:46.146511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:46.148809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:46.156532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 184/364] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:45 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=8c530229735042e8958733424a56358b => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:46.157393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.270977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12679f-6f6c-45cb-8dab-ff7d2bc55218 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.287059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a057b09-15b5-49be-b4e3-4269311645a2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.311738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:46.329353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.329981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.330260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.330532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.331405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:46.331717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:46.333466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:46.344618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 181/365] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=63bab4de085f498f963ba60424cdcde1 => generated 260 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:46.344618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.352031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.352924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.353321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.353693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.380461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:46.390351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:46.391339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:46.392131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 185/366] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:46.392786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.494769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:46.532890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa199c-26ef-41a2-a00a-635edb13db9f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.556297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8556db50-d513-456f-bf87-bcc99d6ef87a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.589407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.590034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.590316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.590587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.591343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] RBAC: Adding query filter params (name=reader) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:46.591648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:46.593170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:46.602795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.603669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.604166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.604429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 182/367] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:46.604740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.605280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.630812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:46.641492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:46.642450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 186/368] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:46.643286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.687224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:46.782854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008641e8-40d4-4009-868a-7dad7a4e0681 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.830647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3082ef56-3a96-4fde-8c15-95a770f6d805 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:46.845960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:46.859466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.860250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.860631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.861005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.861851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:46.862252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:46.863802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:46.874185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:46.874864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:46.875150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:46.875425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] PATH_INFO: `/v3/users/d154c92d1a4f4aa99a036e858a7a109b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:46.876759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] RBAC: Authorizing `identity:get_user(user_id=d154c92d1a4f4aa99a036e858a7a109b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:46.878229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:46.879861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 187/369] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/users/d154c92d1a4f4aa99a036e858a7a109b => generated 293 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:46.882605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 183/370] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:46.883298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:46.887208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:47.004237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394e193a-67b7-4c8e-81f0-0512823605d2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:47.045738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:47.046362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:47.046633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:47.046945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:47.047619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:47.048192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:47.049596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:47.062663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 188/371] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:47.063612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:47.131171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:47.171319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71312390-fd3b-4121-89f6-2eec6bae2d71 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:47.198480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:47.217473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe52b7-cd2c-41b8-9265-b082720cc8fc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:47.240813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:47.241560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:47.241938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:47.242423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:47.243241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] RBAC: Adding query filter params (role.id=06e64363f6d940708ca457ba5bb23067, user.id=d154c92d1a4f4aa99a036e858a7a109b, scope.system=all) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:47.243555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:47.246427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:47.270240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 184/372] 10.222.0.39 () {56 vars in 1308 bytes} [Wed Aug 17 23:13:46 2022] GET /identity/v3/role_assignments?user.id=d154c92d1a4f4aa99a036e858a7a109b&scope.system=all&role.id=06e64363f6d940708ca457ba5bb23067 => generated 510 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:47.271116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:47.286663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:47.287331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:47.287611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:47.287884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:47.444452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:47.448527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:47.496665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239653b-244d-4da1-854d-51fe932f597c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:47.533009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:47.567796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:47.568799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:47.569308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:47.569877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:47.615985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:47.654305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:47.656439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:47.661362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 189/373] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:47.681123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:47.774547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 185/374] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:47.780454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:47.900185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52349c6b-5f55-4e02-a0ca-35b6ca15118c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:47.923099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:47.963663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:47.964303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:47.964591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:47.964867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:47.967789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:47.968462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57d3e7-2fc8-438d-aaa7-206870721dcc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:47.969232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:47.975326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 190/375] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:47 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:47.981257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:48.001339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:48.012052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:48.013222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.013707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.014182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] PATH_INFO: `/v3/projects/f53e7d1f09604616930e1b6b4872ea9e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.015661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] RBAC: Authorizing `identity:get_project(project_id=f53e7d1f09604616930e1b6b4872ea9e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:48.017373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:48.019823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 186/376] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:47 2022] GET /identity/v3/projects/f53e7d1f09604616930e1b6b4872ea9e => generated 344 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:48.028021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:48.125287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b855c0-b660-42fe-bac8-e7b38688b268 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:48.183128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977340fd-372b-484a-8038-aa7a888853f3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:48.197195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:48.197842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.198125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.198402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.201232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:48.202988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:48.204586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 191/377] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:47 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:48.223581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:48.260502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:48.261155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.261441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.261721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] PATH_INFO: `/v3/groups/64cff12ec3eb48a5986b29aa1aa7996c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.272149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] RBAC: Authorizing `identity:get_group(group_id=64cff12ec3eb48a5986b29aa1aa7996c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:48.274925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:48.280412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 187/378] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:48 2022] GET /identity/v3/groups/64cff12ec3eb48a5986b29aa1aa7996c => generated 229 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:48.292012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:48.297321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:48.379793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:48.440872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f55aa4-0322-4c09-99ac-8d3a80af9fab None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:48.454487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c6c3f6-c5fe-4094-b031-08e6e2c1449e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:48.511528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:48.512188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.512469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.512850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.513694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=8c530229735042e8958733424a56358b, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:48.514007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:48.515641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c1330-a5ea-4253-b871-e1908de1b351 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:48.521634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 192/379] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:48 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=8c530229735042e8958733424a56358b => generated 260 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:48.522624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:48.523592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.524127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.524602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.525635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] RBAC: Adding query filter params (group.id=64cff12ec3eb48a5986b29aa1aa7996c, role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=f53e7d1f09604616930e1b6b4872ea9e) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:48.526158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:48.528183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54587810-3591-40a8-910c-72d4538ab7d5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:48.535390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 188/380] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:48 2022] GET /identity/v3/role_assignments?group.id=64cff12ec3eb48a5986b29aa1aa7996c&scope.project.id=f53e7d1f09604616930e1b6b4872ea9e&role.id=585c0d47a790421289bad938a0377b4f => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:48.787434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9ad1e-b1ce-4747-8cdb-26bacbf08ed6 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.787724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9ad1e-b1ce-4747-8cdb-26bacbf08ed6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.788015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc9ad1e-b1ce-4747-8cdb-26bacbf08ed6 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.789777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 193/381] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:48.795300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2bee0-1822-49d8-9c28-a2077d5fbf72 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.795653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2bee0-1822-49d8-9c28-a2077d5fbf72 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.795938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b2bee0-1822-49d8-9c28-a2077d5fbf72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.820392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-38b2bee0-1822-49d8-9c28-a2077d5fbf72 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:48.821657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-38b2bee0-1822-49d8-9c28-a2077d5fbf72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:48.875742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b71cd9-63ab-4213-a55d-8f9e4848bd94 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.876048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b71cd9-63ab-4213-a55d-8f9e4848bd94 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.876306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b71cd9-63ab-4213-a55d-8f9e4848bd94 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.878333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 194/382] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:48.884262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ccc1-8f8a-4e09-9d7c-8b3ffb4e552b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:48.884559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ccc1-8f8a-4e09-9d7c-8b3ffb4e552b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:48.884982 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f809ccc1-8f8a-4e09-9d7c-8b3ffb4e552b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:48.903762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:48.907584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f809ccc1-8f8a-4e09-9d7c-8b3ffb4e552b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:48.910880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f809ccc1-8f8a-4e09-9d7c-8b3ffb4e552b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:48.913559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 189/383] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:49.016058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 195/384] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:49.160137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439398-7cc8-4ba9-b0a9-13d32db1ba87 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.160770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439398-7cc8-4ba9-b0a9-13d32db1ba87 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.161239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f439398-7cc8-4ba9-b0a9-13d32db1ba87 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.163030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 190/385] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:49.169383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.169680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.169963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.196857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:49.198058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:49.283397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 196/386] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:49.358547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439398-7cc8-4ba9-b0a9-13d32db1ba87 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:49.490810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f439398-7cc8-4ba9-b0a9-13d32db1ba87 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:49.529421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:49.530053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:49.530162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.530334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.530610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.537572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:49.543049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:49.547943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:49.548816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:49.549635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 191/387] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:49.555333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:49.619700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:49.677101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11dd8e-82d1-4236-a0b5-0847e64bcf25 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:49.713071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5482e7c-4ed3-4d24-ac6b-a3c81af68579 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:49.736271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:49.737299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.737587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.737865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.738602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:49.738934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:49.740398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:49.753367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 192/388] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:49.758016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:49.761701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:49.762595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.763110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.763586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.774893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:49.780691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:49.781625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:49.782452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:49.785779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 197/389] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:49.786803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:49.860983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:49.885565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc6afcb-fc20-439f-8d49-63095cda7a7c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:49.909795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:49.918982 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfd070b-9192-4be8-93d2-df60492e6a55 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:49.937183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:49.937827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.938113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.938401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.953025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:49.961129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:49.962052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:49.962862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 193/390] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:49.963569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:49.967800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:49.968728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:49.969467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:49.969969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:49.972898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:49.975226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:49.978756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 198/391] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:49.980195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.104754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a9ad7-f71c-4924-84c0-f510f84102b9 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.105978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dc955e-4dc8-41e2-afaa-285f95098c17 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.135425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:50.140765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.141793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.142470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.142771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.143447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:50.143769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.145130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.147009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.147943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.148437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.148918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.149808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:50.150426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.152014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.154281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 199/392] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.155249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.162206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 194/393] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.163947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.212109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:50.257494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e933f8b0-8c23-4650-9b2e-22c34ead47ea None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.282687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3931e73e-a217-4fc8-a94b-2f4d15d75110 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.292815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.293458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.293744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.294024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.295203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.296663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.298791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 200/394] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:50 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.299467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.329285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.330393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.330924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.331417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.333339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.335748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.338140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 195/395] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:50 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.340096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.367398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:50.413742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990259bc-4f90-4620-801d-2d7df5d928d5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.455808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.457078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.457967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.458461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.459932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.463027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.466009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 201/396] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:50 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.467134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.474422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3351962d-7b84-48de-9716-8f78fb816ff1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.484488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:50.512214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.512625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.512909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.513182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/groups/5f913e75755e4463a18596c3d2c000a7/roles/8c530229735042e8958733424a56358b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.515376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f4b1e629c4f22bcdab682d614609c, group_id=5f913e75755e4463a18596c3d2c000a7, role_id=8c530229735042e8958733424a56358b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.516821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.531838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 196/397] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 17 23:13:50 2022] PUT /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/groups/5f913e75755e4463a18596c3d2c000a7/roles/8c530229735042e8958733424a56358b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:50.532678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.596439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead8b6eb-1e6c-44ec-93a6-a8cc64344743 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.629607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:50.637837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.638905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.639427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.639913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.641484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.643234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.645540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 202/398] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:50 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.651020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a7b33f-4320-42d4-950b-42ae29da8d14 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.652575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.704204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.704954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.705241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.705518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.707391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.708842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.710687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 197/399] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:50 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:50.716702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:50.787770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:50.842989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12358be0-7b15-4a9f-92d0-72ee30cd417d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.873142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dce742-a1a6-445c-ab82-96d5cefd031c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:50.890645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ac23e1-0c21-4cac-8936-9b9b7664c80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.891286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac23e1-0c21-4cac-8936-9b9b7664c80c None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.891573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac23e1-0c21-4cac-8936-9b9b7664c80c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.891874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ac23e1-0c21-4cac-8936-9b9b7664c80c None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/groups/5f913e75755e4463a18596c3d2c000a7/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.893765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac23e1-0c21-4cac-8936-9b9b7664c80c None admin] RBAC: Authorizing `identity:create_grant(project_id=51d32dba71b34e72886cd24d0f55fdd2, group_id=5f913e75755e4463a18596c3d2c000a7, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.895253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ac23e1-0c21-4cac-8936-9b9b7664c80c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.910924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 203/400] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 17 23:13:50 2022] PUT /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/groups/5f913e75755e4463a18596c3d2c000a7/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:50.912135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768793-18b4-472e-b1d4-18f00c804aa2 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.912424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768793-18b4-472e-b1d4-18f00c804aa2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.912699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e768793-18b4-472e-b1d4-18f00c804aa2 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.914323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 204/401] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:50.915480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001efc-2fa3-48e2-844b-4184a6d8d460 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.915789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001efc-2fa3-48e2-844b-4184a6d8d460 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.916048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39001efc-2fa3-48e2-844b-4184a6d8d460 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.917506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 205/402] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:50.923223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.923537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.923783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.930743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3466f5f2-1c6a-4c24-96d7-4752f8bd4a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:50.931911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f5f2-1c6a-4c24-96d7-4752f8bd4a10 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.932422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f5f2-1c6a-4c24-96d7-4752f8bd4a10 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.932922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3466f5f2-1c6a-4c24-96d7-4752f8bd4a10 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/groups/5f913e75755e4463a18596c3d2c000a7/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.935262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466f5f2-1c6a-4c24-96d7-4752f8bd4a10 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc9f4b1e629c4f22bcdab682d614609c, group_id=5f913e75755e4463a18596c3d2c000a7, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:50.937045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3466f5f2-1c6a-4c24-96d7-4752f8bd4a10 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:50.944065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:50.946235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:50.955394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 198/403] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 17 23:13:50 2022] PUT /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c/groups/5f913e75755e4463a18596c3d2c000a7/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:13:50.957242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:50.957827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:50.958391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:50.980936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:50.982781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:51.050389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:51.080963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 206/404] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:51.113269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 199/405] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:51.365478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:51.494763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5fc13-7395-4c38-b3d6-b9f4ae6cfbf5 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:51.498276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:51.534676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:51.536123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:51.536612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:51.537101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:51.549610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:51.555819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:51.556742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:51.557535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:51.560382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 207/406] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:51.562048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:51.568440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:51.634132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:51.728732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb27b15c-ace5-4d29-9dcc-fc694816d203 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:51.735330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad144ce-7871-422c-858a-126d839e01ee None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:51.802093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:51.802654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:51.802957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:51.803234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:51.808724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:51.809435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:51.809723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:51.810004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:51.810678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:51.811005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:51.812389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:51.825640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 208/407] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:51.831188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:51.834076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:51.839718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:51.840585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:51.841357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:51.843933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 200/408] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:51.849180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:51.982317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:51.991895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880762f-27f6-4300-be9b-7788d026d6c8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.054878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a0e63-9ee4-47aa-abe6-ab06ab403477 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.059425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.060069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.060363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.060650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.061334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:52.061644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.063070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.067154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:52.087000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 201/409] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:52.094322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:52.115706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.116402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.116797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.117465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.118650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.120136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.122176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 209/410] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:51 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:52.132448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:52.269262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d0edda-9874-416b-94d8-154c2166e728 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.316194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84828f1-7e47-4bc1-9bee-85b4912e4d98 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.337348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.337980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.338257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.338530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] PATH_INFO: `/v3/groups/64cff12ec3eb48a5986b29aa1aa7996c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.340413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] RBAC: Authorizing `identity:get_group(group_id=64cff12ec3eb48a5986b29aa1aa7996c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.341848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.344647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 202/411] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:52 2022] GET /identity/v3/groups/64cff12ec3eb48a5986b29aa1aa7996c => generated 229 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:52.351801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:52.385423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.387289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.387572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.388906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.389718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:52.392304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.395327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.401737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 210/412] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:52 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:52.407702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:52.502049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:52.554181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286f978c-2218-4d4a-a47b-b417df69ac35 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.586609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a9ac8c-c9d1-4398-9d64-f8cbada26f1e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.608026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.608927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.609584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.610665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] PATH_INFO: `/v3/projects/f53e7d1f09604616930e1b6b4872ea9e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.612112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] RBAC: Authorizing `identity:get_project(project_id=f53e7d1f09604616930e1b6b4872ea9e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.614426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.618532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 203/413] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:52 2022] GET /identity/v3/projects/f53e7d1f09604616930e1b6b4872ea9e => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:52.628155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:52.656455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88842669-8828-4554-834d-4d0dbd453f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.658032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842669-8828-4554-834d-4d0dbd453f76 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.658684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842669-8828-4554-834d-4d0dbd453f76 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.659934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88842669-8828-4554-834d-4d0dbd453f76 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/groups/5f913e75755e4463a18596c3d2c000a7/roles/8c530229735042e8958733424a56358b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.663967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842669-8828-4554-834d-4d0dbd453f76 None admin] RBAC: Authorizing `identity:create_grant(project_id=51d32dba71b34e72886cd24d0f55fdd2, group_id=5f913e75755e4463a18596c3d2c000a7, role_id=8c530229735042e8958733424a56358b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.669085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88842669-8828-4554-834d-4d0dbd453f76 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.690623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 211/414] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 17 23:13:52 2022] PUT /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2/groups/5f913e75755e4463a18596c3d2c000a7/roles/8c530229735042e8958733424a56358b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:52.760410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:52.780779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbc88d-01d7-4771-874b-3317c92ccdc1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:52.824840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b98f73-ca47-4c87-b147-460768727233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:52.825751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b98f73-ca47-4c87-b147-460768727233 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.826171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b98f73-ca47-4c87-b147-460768727233 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.826609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b98f73-ca47-4c87-b147-460768727233 None admin] PATH_INFO: `/v3/projects/f53e7d1f09604616930e1b6b4872ea9e/groups/64cff12ec3eb48a5986b29aa1aa7996c/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.828772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b98f73-ca47-4c87-b147-460768727233 None admin] RBAC: Authorizing `identity:create_grant(project_id=f53e7d1f09604616930e1b6b4872ea9e, group_id=64cff12ec3eb48a5986b29aa1aa7996c, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:52.830414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b98f73-ca47-4c87-b147-460768727233 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:52.846493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 204/415] 10.222.0.39 () {58 vars in 1442 bytes} [Wed Aug 17 23:13:52 2022] PUT /identity/v3/projects/f53e7d1f09604616930e1b6b4872ea9e/groups/64cff12ec3eb48a5986b29aa1aa7996c/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:13:52.938519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f09c5-017a-4660-8b62-5cec035a0e96 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.939094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f09c5-017a-4660-8b62-5cec035a0e96 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.939540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f09c5-017a-4660-8b62-5cec035a0e96 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.941343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 212/416] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:52.947554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9594e-56a7-426d-95c3-3b90b85bc088 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:52.948225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9594e-56a7-426d-95c3-3b90b85bc088 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:52.948697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9594e-56a7-426d-95c3-3b90b85bc088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:52.969077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-99c9594e-56a7-426d-95c3-3b90b85bc088 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:52.970632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-99c9594e-56a7-426d-95c3-3b90b85bc088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:53.050538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 205/417] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:53.116560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5678da-34a4-4a37-84ba-b887c6187351 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.116797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5678da-34a4-4a37-84ba-b887c6187351 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.117140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5678da-34a4-4a37-84ba-b887c6187351 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.118772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 213/418] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:53.136662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf0c8-9dc5-4589-bf78-14cc31251c60 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.137251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf0c8-9dc5-4589-bf78-14cc31251c60 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.137750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039cf0c8-9dc5-4589-bf78-14cc31251c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.167726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-039cf0c8-9dc5-4589-bf78-14cc31251c60 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:53.169399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-039cf0c8-9dc5-4589-bf78-14cc31251c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:53.267069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 206/419] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:53.312388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0d430-51f5-4559-a788-ad6f62cb0e47 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.312711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0d430-51f5-4559-a788-ad6f62cb0e47 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.312941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa0d430-51f5-4559-a788-ad6f62cb0e47 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.314268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 214/420] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:53.319504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.319803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.320089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.331112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:53.347938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:53.349132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:53.453273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 207/421] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:53.472624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0d430-51f5-4559-a788-ad6f62cb0e47 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:53.637953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa0d430-51f5-4559-a788-ad6f62cb0e47 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:53.648690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:53.689047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:53.689047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.689047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.689047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.700565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:53.709928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:53.710827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:53.711615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:53.713866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 215/422] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:53.719657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:53.735369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:53.856798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ceb38d-9577-4004-b3a4-1ced4ec4c485 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:53.863472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d67b71-b102-4b45-ac5c-c8a35641331f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:53.903330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:53.903970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.904254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.904529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.906967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:53.908198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:53.908699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:53.909181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:53.910340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:53.910875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:53.913635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:53.915390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:53.916444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:53.921186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:53.922082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:53.922908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:53.926954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 216/423] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:53.927802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:53.928024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 208/424] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:53.932049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:53.962492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.037328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d62a6a-806e-4302-b5e5-07b49fdcf8fe None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.051662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f10c780-3147-48bd-8afe-3ef9fb5c84a6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.080927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.081580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.082021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.082316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] PATH_INFO: `/v3/roles/member` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.088270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.088946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.089234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.089512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.090197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] RBAC: Adding query filter params (name=member) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:54.090505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.091963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.096247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:54.102160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 209/425] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:54.102743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:54.103615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 17 23:13:54.104881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:54.105731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.105811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 217/426] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:54.111801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.169363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.220463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8818794-5dd5-452a-ab80-96df416b212a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.224025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.245648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9212f46-93d8-4934-a6f1-bfc255f6011a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.260709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.261654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.261946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.262227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.293253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.294098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.294546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.295534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.296676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] RBAC: Adding query filter params (name=member) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:54.297148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.299755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.312466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 218/427] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:54.313549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.359603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.361447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.424255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb076e5f-97c2-4aa8-99e6-fadca55d09db None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.431260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.462804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.463737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.464024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.464304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.483446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.497679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 210/428] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:54.503510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.536359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.538357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.616530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac921113-f35a-4b7e-bb38-d1a404de7ba3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.645535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 219/429] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:54.646466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.656885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.657871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.658349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.658852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.689745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.697490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.738210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.740466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.749938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6aa7d4-3212-4c9a-879c-b8683d4f7f24 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.789415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.790023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.790311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.790589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.791790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.793254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.799505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 220/430] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:54.800380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.857628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 211/431] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:13:54.858915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.906850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3e990-0f75-4b15-957a-f5152136d5f8 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:54.923396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.925963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:54.946638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:54.947509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:54.947729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:54.948010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] PATH_INFO: `/v3/projects/bc9f4b1e629c4f22bcdab682d614609c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:54.949157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] RBAC: Authorizing `identity:get_project(project_id=bc9f4b1e629c4f22bcdab682d614609c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:54.950865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:54.952715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 221/432] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/projects/bc9f4b1e629c4f22bcdab682d614609c => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:54.958061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:54.973588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab754ab-9599-4af6-9d97-4d179aaaa792 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.009549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.010105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.010388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.010664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.011913 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.013470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.015217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 212/433] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.020786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.063609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd20053-c412-4e6a-8e09-e75cd757ecda None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.101437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ac7a6-3b16-4a3f-8099-07cdbfd43c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.102073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ac7a6-3b16-4a3f-8099-07cdbfd43c3a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.102364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ac7a6-3b16-4a3f-8099-07cdbfd43c3a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.102638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ac7a6-3b16-4a3f-8099-07cdbfd43c3a None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.103833 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ac7a6-3b16-4a3f-8099-07cdbfd43c3a None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.105282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ac7a6-3b16-4a3f-8099-07cdbfd43c3a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.106951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 222/434] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:54 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.108153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98a99-f182-4188-9a46-a1b5bfc1438c None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.108451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98a99-f182-4188-9a46-a1b5bfc1438c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.108729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a98a99-f182-4188-9a46-a1b5bfc1438c None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.110086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 223/435] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:55.110681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a98a99-f182-4188-9a46-a1b5bfc1438c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.127287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ad8d79-9878-4960-b95a-ccc8e1c86ccb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.154318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:55.164011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d111380a-e575-4f10-9ac8-3663d6692a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.164642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111380a-e575-4f10-9ac8-3663d6692a6d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.165118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:55.165338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111380a-e575-4f10-9ac8-3663d6692a6d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.165627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d111380a-e575-4f10-9ac8-3663d6692a6d None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.167109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111380a-e575-4f10-9ac8-3663d6692a6d None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.168540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d111380a-e575-4f10-9ac8-3663d6692a6d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.170105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 213/436] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.171245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd649d3-1e18-4040-9d06-d68feaa67316 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.171526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd649d3-1e18-4040-9d06-d68feaa67316 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.171799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd649d3-1e18-4040-9d06-d68feaa67316 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.172987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 214/437] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:55.173673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd649d3-1e18-4040-9d06-d68feaa67316 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.219076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a98a99-f182-4188-9a46-a1b5bfc1438c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.254045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.254651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.254964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.255242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.255971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=8c530229735042e8958733424a56358b, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:55.256289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.258269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac995b45-d713-4582-9efc-caabf6cf460d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.263966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 224/438] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=8c530229735042e8958733424a56358b => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.265038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda1c66-e071-4e8e-9629-4cfa20f47e87 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.265324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda1c66-e071-4e8e-9629-4cfa20f47e87 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.265601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeda1c66-e071-4e8e-9629-4cfa20f47e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.278511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd649d3-1e18-4040-9d06-d68feaa67316 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.288679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-eeda1c66-e071-4e8e-9629-4cfa20f47e87 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:55.290892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-eeda1c66-e071-4e8e-9629-4cfa20f47e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:55.320531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.321183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.321467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.321746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.322970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.324433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.326069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 215/439] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.326909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.384247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 225/440] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:55.387205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.387499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.387777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.407173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:55.408679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:55.420273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:55.461185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:55.473286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53353307-eaa0-4b4d-b1c2-3550506ff3e3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.501460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 226/441] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:55.503905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.515471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.516425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.516890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.517428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.518335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=bc9f4b1e629c4f22bcdab682d614609c) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:55.518908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.520769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.528041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 216/442] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=bc9f4b1e629c4f22bcdab682d614609c&role.id=63bab4de085f498f963ba60424cdcde1 => generated 611 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.618918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214108b6-ca90-4062-b65e-a4aec271151d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.656515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.657375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.657830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.658251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.659168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=63bab4de085f498f963ba60424cdcde1, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:55.659635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:55.661253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:55.665056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.670168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 227/443] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=63bab4de085f498f963ba60424cdcde1 => generated 611 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:55.783903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d277435-8949-4d81-a6e0-0fe7c81858ad None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.814495 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:55.814902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.824728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.825367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.825650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.825923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.837913 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:55.844247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:55.845127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:13:55.846108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 217/444] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:13:55.852566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:55.867185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:55.943214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0724ec-4322-42bb-8d0c-662f7dff9af6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.972041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01c433d-428d-40e3-b552-adccd05d1ebb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:55.980213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:55.980858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:55.981140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:55.981416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:55.992812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:13:55.997902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:13:55.998835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:13:55.999644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 228/445] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:13:56.005112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.016838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.018048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.018322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.018939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.019878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:56.020193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.021760 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.031632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 218/446] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:13:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:56.037300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.096427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.119069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.122378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dcdf95-5e36-4ea3-a2e3-d5c3ddac5134 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.161985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df2f03-4bd7-4b0b-9166-a9c99aaa62ac None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.167239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.167859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.168597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.168597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.169094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:56.169400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.170824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.180225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 229/447] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:13:56.185806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.204411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.205119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.205468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.205666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.284095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.286067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.317835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697bafd0-e4ab-49f8-8475-935bbd63d187 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.337846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.353808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.354415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.354728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.355017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.384957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.389932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 219/448] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:13:56.395446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.423321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.424782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.492802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89029483-760e-48a9-a7eb-cc2009d184b8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.523624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 230/449] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:13:56.527545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.528171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.528729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.528729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] PATH_INFO: `/v3/projects/f53e7d1f09604616930e1b6b4872ea9e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.529576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.529814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] RBAC: Authorizing `identity:get_project(project_id=f53e7d1f09604616930e1b6b4872ea9e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.531288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.533855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 220/450] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/projects/f53e7d1f09604616930e1b6b4872ea9e => generated 344 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:56.539200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.556848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.590033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.626960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13276-af43-41fd-9af6-aec5aaf5f2d0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.639028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec65c2be-b73d-48e3-84ba-f718ad2bec39 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.660961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.661588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.661873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.662148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] PATH_INFO: `/v3/projects/51d32dba71b34e72886cd24d0f55fdd2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.663969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] RBAC: Authorizing `identity:get_project(project_id=51d32dba71b34e72886cd24d0f55fdd2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.665632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.667310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 231/451] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/projects/51d32dba71b34e72886cd24d0f55fdd2 => generated 302 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:56.672572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.672896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.673196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.673475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.673743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] PATH_INFO: `/v3/groups/64cff12ec3eb48a5986b29aa1aa7996c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.674864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] RBAC: Authorizing `identity:get_group(group_id=64cff12ec3eb48a5986b29aa1aa7996c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.676292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.677825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 221/452] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/groups/64cff12ec3eb48a5986b29aa1aa7996c => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:56.683899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.765697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.771618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7c0e0-e2a9-470e-a6c9-793b95d3bca3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.781680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57232699-d57f-4258-af55-a6fe1c79f25e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.800150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:56.806092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.806737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.807017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.807287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] PATH_INFO: `/v3/groups/5f913e75755e4463a18596c3d2c000a7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.808391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] RBAC: Authorizing `identity:get_group(group_id=5f913e75755e4463a18596c3d2c000a7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.809820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.811418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 232/453] 10.222.0.39 () {56 vars in 1180 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/groups/5f913e75755e4463a18596c3d2c000a7 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:56.814912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.815511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.815788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.816069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.816773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] RBAC: Adding query filter params (group.id=64cff12ec3eb48a5986b29aa1aa7996c, role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=f53e7d1f09604616930e1b6b4872ea9e) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:56.817067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:13:56.817160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.818476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dec2e7-cd8f-4d1f-91e3-9c2c27372367 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.824986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 222/454] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/role_assignments?group.id=64cff12ec3eb48a5986b29aa1aa7996c&scope.project.id=f53e7d1f09604616930e1b6b4872ea9e&role.id=585c0d47a790421289bad938a0377b4f => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:56.922022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ed286d-dc24-4d7c-9d40-9ebdebc4c7e3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:13:56.957233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:13:56.957843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:56.958124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:56.958396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:56.959157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] RBAC: Adding query filter params (group.id=5f913e75755e4463a18596c3d2c000a7, role.id=8c530229735042e8958733424a56358b, scope.project.id=51d32dba71b34e72886cd24d0f55fdd2) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:13:56.959468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:13:56.961961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c791915-4f51-467a-ae71-9b73a0a9ae3a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:13:56.968206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 233/455] 10.222.0.39 () {56 vars in 1376 bytes} [Wed Aug 17 23:13:56 2022] GET /identity/v3/role_assignments?group.id=5f913e75755e4463a18596c3d2c000a7&scope.project.id=51d32dba71b34e72886cd24d0f55fdd2&role.id=8c530229735042e8958733424a56358b => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:13:59.426820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337475fa-debb-4cd5-8546-78cdadefe1c5 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:59.427352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337475fa-debb-4cd5-8546-78cdadefe1c5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:59.427352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337475fa-debb-4cd5-8546-78cdadefe1c5 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:59.429740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 223/456] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:13:59.435311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:59.435989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:59.435989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:59.463723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:59.464934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:59.535786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a328b-8f5a-4828-a1a4-bddc3d03cb6c None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:59.535786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a328b-8f5a-4828-a1a4-bddc3d03cb6c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:59.535786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9a328b-8f5a-4828-a1a4-bddc3d03cb6c None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:59.536496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 224/457] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:13:59.541772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2289a-a3e9-4cad-a91f-148b424c91ed None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:13:59.542297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2289a-a3e9-4cad-a91f-148b424c91ed None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:13:59.542825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff2289a-a3e9-4cad-a91f-148b424c91ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:13:59.549492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:13:59.564017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-dff2289a-a3e9-4cad-a91f-148b424c91ed None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:13:59.564863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 234/458] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:13:59.565839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dff2289a-a3e9-4cad-a91f-148b424c91ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:13:59.638200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 225/459] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:13:59.990403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.012721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d120bf2-6944-4970-9742-78e339c1a454 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.013363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d120bf2-6944-4970-9742-78e339c1a454 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.013977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d120bf2-6944-4970-9742-78e339c1a454 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.015834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 226/460] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:00.021143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.021426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.021703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.048030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:00.049218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:00.126890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b251ec-c719-4387-b57f-64c333e66193 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.132086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 227/461] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:00.133007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.149806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:00.164514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.165155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.165433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.165709 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.176071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.177509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f7e03f6d-c0ff-4485-badc-2b64b240bc21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:00.197476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:00.198434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:00.199326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:00.199326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:00.199326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:00.199326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 235/462] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:00.200101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6fef-1eed-42cb-96ae-f214e71995b5 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.200387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6fef-1eed-42cb-96ae-f214e71995b5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.200658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a6fef-1eed-42cb-96ae-f214e71995b5 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.201943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 236/463] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:00.206731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6fef-1eed-42cb-96ae-f214e71995b5 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.255052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8643fc5-7d51-421e-9fc1-ed151143fba9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.255908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:00.293866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.294533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.294875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.295153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.306674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.308357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.317411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a6fef-1eed-42cb-96ae-f214e71995b5 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-bb99a64e-66f8-42c9-9916-0ce4927df438 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:00.324158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:00.325222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:00.326255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:00.326255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:00.326255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:00.326255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 228/464] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:00.326865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.327147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.327414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.347000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:00.348271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:00.357461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.358371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.358881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.359371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.360220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:00.360713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.362279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.374908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 237/465] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:00.376057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.410786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:00.424270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 229/466] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:00.425082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.481859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bb6214-8186-484b-afd2-c7a64694505e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.495607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:00.527684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.528714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.529421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.529900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.530919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:00.531594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.533352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.538834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f07bdd-71b3-466e-8d0e-4c1b248d90e8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.547653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 238/467] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:00.548949 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.575209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.575924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.576206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.576480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.577455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.578740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.605879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 230/468] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:14:00 2022] POST /identity/v3/users => generated 246 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:00.606758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.685570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e7f8-ba35-46ef-b0d1-b54170cbed9b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.686275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:00.766921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.767565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.767849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.768125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.782015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.782180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2403928c-87a8-409f-bd91-1b5cfe6fd432 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:00.784284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:00.800304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:00.801419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:00.802329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:00.802329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:00.802329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:00.802489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 239/469] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:00.804039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.824418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:00.828749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:00.830068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:00.830356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:00.830634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:00.831316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:00.832793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:00.858288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 231/470] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:14:00 2022] POST /identity/v3/users => generated 248 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:00.864023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:00.943242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb18103-2e72-4783-a0f2-691f3d63714e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.011029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.011410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.011700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.011978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.018607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23317fc-4475-4a40-9e04-c6aed92276ee None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.020314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:01.028472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:01.029958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-1bfe099e-e9fc-44d8-aa43-7bba9b1bd713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:01.046827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:01.047783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:01.048690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:01.048690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:01.048690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:01.048690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 240/471] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:01.049487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277ba7e-b01c-4803-bbc7-50686e7e5016 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.049773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277ba7e-b01c-4803-bbc7-50686e7e5016 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.050045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277ba7e-b01c-4803-bbc7-50686e7e5016 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.052126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 241/472] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:01.055601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277ba7e-b01c-4803-bbc7-50686e7e5016 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:01.063470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.064095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.064374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.064645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.065298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:01.065601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:01.067018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561eaff2-975f-439e-b091-775e0d9749d2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:01.080247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 232/473] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:01.081670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.081780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.082026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.101830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:01.103057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:01.158060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:01.187810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 233/474] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:01.188680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:01.203009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277ba7e-b01c-4803-bbc7-50686e7e5016 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.244035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.244919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.245207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.245926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.246597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:01.246938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:01.248872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:01.264539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 242/475] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:01.269839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:01.389360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:01.392286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aea20-6c98-452b-9231-fe76d2f7f73f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.411589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809e5255-1e68-4f7e-996f-68ca6e3f56d3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.426674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:01.437028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.438137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.438613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.439063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.439852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:01.441447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:01.479001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.479626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.480075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.480357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.481055 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:01.482599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:01.483549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 243/476] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:14:01 2022] POST /identity/v3/users => generated 249 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:01.507770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 234/477] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:14:01 2022] POST /identity/v3/users => generated 248 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:01.622048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:01.751573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe3e5be-900c-4749-ae5f-a456f9de5119 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.788596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.789213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.789497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.789773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.790434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:01.791843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:01.800940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.sql.core [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 23:14:01.800940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 23:14:01.800940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [parameters: {'id': 'fa46fbc954d34f2297f4db35ae2a8933', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 23:14:01.800940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85577) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application conn.query(q) Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application result.read() Aug 17 23:14:01.818587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return ref.to_dict() Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 23:14:01.819590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application next(self.gen) Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application yield resource Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application next(self.gen) Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise self.value Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application session.commit() Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 23:14:01.820484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self.session.flush() Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application compat.raise_( Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 23:14:01.821356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 23:14:01.822224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application conn.query(q) Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application result.read() Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 23:14:01.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [parameters: {'id': 'fa46fbc954d34f2297f4db35ae2a8933', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:01.823835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 17 23:14:01.824614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:01.827368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 244/478] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 17 23:14:01 2022] POST /identity/v3/roles => generated 144 bytes in 199 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:01.827505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:01.941952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f6bbdf-0690-4d0b-bff4-2cef734cee79 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:01.980075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be88371-e629-4e5b-bf78-bb56506d934d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:01.980728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88371-e629-4e5b-bf78-bb56506d934d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:01.981004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88371-e629-4e5b-bf78-bb56506d934d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:01.981279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be88371-e629-4e5b-bf78-bb56506d934d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:01.992893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be88371-e629-4e5b-bf78-bb56506d934d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-2be88371-e629-4e5b-bf78-bb56506d934d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:01.998511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:01.999502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:02.000300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 235/479] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:02.006068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:02.063082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:02.112915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e83a9-657b-4f33-9f8c-2455e2716454 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:02.147859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:02.148475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:02.148763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:02.149041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:02.149716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:02.150025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:02.151439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1452288-63d7-4e59-b816-ff7fd6d39b13 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:02.160437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 245/480] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:02.908807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dac13-debf-4caf-9c67-1383cd9c5760 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:02.909939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dac13-debf-4caf-9c67-1383cd9c5760 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:02.910425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6dac13-debf-4caf-9c67-1383cd9c5760 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:02.912193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 236/481] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:02.918643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60a36-2d20-4cf1-b599-197ed6ab8395 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:02.919493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60a36-2d20-4cf1-b599-197ed6ab8395 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:02.919986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab60a36-2d20-4cf1-b599-197ed6ab8395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:02.947964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cab60a36-2d20-4cf1-b599-197ed6ab8395 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:02.949692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cab60a36-2d20-4cf1-b599-197ed6ab8395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:03.046865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 246/482] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:14:03.290957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1dd3-9737-41ae-b710-8a8354f421e1 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:03.291244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1dd3-9737-41ae-b710-8a8354f421e1 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:03.291518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97f1dd3-9737-41ae-b710-8a8354f421e1 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:03.293112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 237/483] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:03.298348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:03.298636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:03.298948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:03.317801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:03.319092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:03.356818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:03.393761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 247/484] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:03.393971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1dd3-9737-41ae-b710-8a8354f421e1 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:03.417189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:03.576329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97f1dd3-9737-41ae-b710-8a8354f421e1 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:03.621816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:03.622916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:03.623406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:03.623868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:03.639089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:03.643849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:03.644731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:03.645506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 238/485] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:03.651307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:03.762605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860dd87-5922-419a-892e-add3df0f3919 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:03.772636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:03.819230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:03.819520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:03.819791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:03.820256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:03.821018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:03.821302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:03.822693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:03.834803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 248/486] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:03.837648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:03.915155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:03.919963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:03.958032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494adcad-e78d-4162-a370-1fe4eb39ffb7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:03.980485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a80e8f-2465-4fa2-bb3f-793d870e3f4f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:03.995610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb9844d-6805-4f70-b18d-751f3ee5c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:03.996458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9844d-6805-4f70-b18d-751f3ee5c719 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:03.996927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9844d-6805-4f70-b18d-751f3ee5c719 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:03.997359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb9844d-6805-4f70-b18d-751f3ee5c719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.009566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb9844d-6805-4f70-b18d-751f3ee5c719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-6fb9844d-6805-4f70-b18d-751f3ee5c719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:04.015425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:04.016478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:04.017431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:04.019953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 239/487] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:04.021315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.021520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953fbbd-be41-4f54-b120-8354c2eb1870 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.022004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953fbbd-be41-4f54-b120-8354c2eb1870 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.022581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.022696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b953fbbd-be41-4f54-b120-8354c2eb1870 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.023130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.023546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.028387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 240/488] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:04.028387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953fbbd-be41-4f54-b120-8354c2eb1870 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.041875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.044250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e8a2f4c8-655d-4f2b-84d4-3812f40889c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:04.064998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:04.066107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:04.067216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:04.067216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:04.067216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:04.069807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 249/489] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:04.071224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.071646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.072048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.098334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:04.100334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:04.158401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b953fbbd-be41-4f54-b120-8354c2eb1870 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.189320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:04.197995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 250/490] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:04.199139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.200065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.200939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.201415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.201938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.202833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:04.203345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.204944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f214353-bc04-40d1-9126-2435b9b8a4d4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.216300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 241/491] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:04.219229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2486-0557-4b6e-89ab-b8260235320e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.219717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2486-0557-4b6e-89ab-b8260235320e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.220260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef2486-0557-4b6e-89ab-b8260235320e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.221886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 242/492] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:04.222793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2486-0557-4b6e-89ab-b8260235320e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.223905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:04.325098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bba2735-c275-419c-9fba-515895e2dd3d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.360891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef2486-0557-4b6e-89ab-b8260235320e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.370045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.371441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.371925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.372838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.374001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:04.374508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.376825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9e4c01-d1aa-42d6-9727-3cbe036ed03c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.394151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 251/493] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:04.395749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.396328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.397050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.397970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.398876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.399232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.399621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.411014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.413103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.420144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:04.422015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:04.428865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:04.429737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:04.430585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:04.430585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:04.430585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:04.434932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 243/494] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:04.435920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.493175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:04.517977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 252/495] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:04.518669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.524892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:04.564124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb1ac17-582d-4d79-83fd-de686586c3c6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.602932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.603559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.603839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.604109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.613076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.614511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:04.628701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:04.629630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:04.630554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 244/496] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:04.631714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.662224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d49d16-3967-4ae3-a92a-1ccc0a8dd641 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.700712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.701319 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.701599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.701869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.702516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:04.702902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.704567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.717414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 253/497] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:04.717906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.765741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2e7fb7-95fa-4854-9cb0-5e53186d8ef7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.767448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:04.795710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:04.810090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.811327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.811830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.812205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.824848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:04.830022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:04.830959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:04.831805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 245/498] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:04.832444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.840160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f04d5-0f13-41cf-b045-6b4b4513770d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.874016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.874545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.874860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.875136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.875858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:04.876160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.877582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a92be7-ef08-459b-922b-9bfa7301713c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.914687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 254/499] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:04.915923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968caac7-b9f0-46d0-a091-ea9af9c16781 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.916212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968caac7-b9f0-46d0-a091-ea9af9c16781 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.916485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968caac7-b9f0-46d0-a091-ea9af9c16781 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.917835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 255/500] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:04 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:04.918347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968caac7-b9f0-46d0-a091-ea9af9c16781 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:04.935888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a287b2-7de9-4e5f-87db-7aaa3a040acd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:04.968171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:04.968786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:04.969057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:04.969329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] PATH_INFO: `/v3/users/glance` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:04.977175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:04.978630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:04.989418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:04.991145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 246/501] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:04.992367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.019852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.021317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968caac7-b9f0-46d0-a091-ea9af9c16781 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.044997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.057058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.057689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.057980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.058262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.068282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:05.073663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:05.074681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:05.075558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 256/502] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:05.076230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.100806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e90376-ce62-4686-afdc-757f6251e202 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.141150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.141679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.141967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.142240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.142940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:05.143245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.144622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84d0fc0-185c-471b-bb41-14a723e24f7c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.158066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 247/503] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:05.158066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.158066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.158066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.173949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:05.175184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:05.182929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b49604-4cc9-47a3-9825-9943be772fc4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.216125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.216732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.217019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.217297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.242432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 248/504] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:05.243528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.258248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.281354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.305532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.307032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.355668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e303714c-6845-4fdd-9b31-2d7beeef8f56 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.393969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.394613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.394928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.395206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.395939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:05.396248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.398229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.418286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 257/505] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:05.418286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.435662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 249/506] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:05.441011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.507745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.518891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.530344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f31b67-b07e-4eae-8f8c-84d1f7bd402d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.551023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f116a3-ebbf-4dbd-afc6-584d0101d303 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.564818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.565452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.565733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.566006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.566666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:05.566998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.568444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.576785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 258/507] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:05.577701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.590157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.590826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.591109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.591386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.602865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.604328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:05.618108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:05.619063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:05.619932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:05.619932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:05.619932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:05.619932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 250/508] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:05.620143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.680972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602bc18d-2e33-4731-9d78-8c30ccc0a7f3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.714224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.714882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.715164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.715441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.720141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e699bd01-37a3-4054-a4bc-256c4d5d5845 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.726223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.727729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.730223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:05.743175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:05.744307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:05.746288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:05.746288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:05.746288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:05.746288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 259/509] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:05.746288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.750866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.763582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.764194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.764483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.764759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.833131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.835320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.845567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f1d44e-a38a-448e-a418-0ab21350119e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:05.879077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:05.879699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:05.879985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:05.880267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:05.891071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:05.892521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:05.907037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:05.908125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:05.908959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:05.908959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:05.908959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:05.908959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 260/510] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:05.908959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.939120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 251/511] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:05.939890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:05.961355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:05.965400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.012497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e122db2-58a8-4f5d-b8b5-9669ffd8c068 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.040497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dd3683-c78c-4bbf-a249-149504236be2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.047773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.048394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.048675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.048946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.059087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.060533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:06.074849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:06.075772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:06.076643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:06.076643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:06.076643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:06.076643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 261/512] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:06.076857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.080043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.080666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.080950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.081226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.081874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:06.082179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.083585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.096713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 252/513] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:06.097516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.176846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.179807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb4bddf-ff99-4b4f-bbc4-d3ca3cfd25fa None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.181565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.197650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf74cb8-f701-4b72-804f-776a6920e06c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.213119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.213720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.214007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.214279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.214943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:06.215244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.216601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.228384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 262/514] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:06.229168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.231482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.232094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.232377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.233040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.233698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:06.234005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.235432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.247812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 253/515] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:06.248612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.331786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0886fec-e397-4a56-8056-b43d3578d0c4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.347252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c6cd7-a54f-4067-8ac7-b903ff40cf7e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.365280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.365913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.366197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.366477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.376732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.378186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.380217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.380816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.381764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.382138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.382811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:06.383118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.384478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:06.393022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:06.393933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:06.395251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:06.395251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:06.395251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:06.395251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 263/516] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:06.395251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.401028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 254/517] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:06.401028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.401028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.413643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.497667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccc11d1-2c68-4ede-a059-395e9b9c477b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.513713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8e5db3-a42c-4dad-a88a-862df12da22a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.530195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.530858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.531137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.531409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.539349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.541768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.547583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.548201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.548479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.548751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:06.554651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:06.555718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 264/518] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:06.556820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.558931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.560414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:06.572945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:06.573794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:06.574667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 255/519] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:06.575235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.632385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.636411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.663196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e099d9-f4e5-404c-a939-41aee3523e81 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.674180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9353cbd-17bf-4da1-9516-15063a1215db None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.696473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.697070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.697349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.697631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.698253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.699733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.707597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.708199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.708483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.708757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.709957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:06.710262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.711712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.720292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 265/520] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:14:06 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:06.721000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.731598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 256/521] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:06.732772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.846760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56c65e4-74e7-4fa2-8b98-f43aab32533c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.849396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd30f41-2c26-4abd-a78b-2ca4ee410717 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:06.875703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.879188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:06.885801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.886426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.886730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.887032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.894105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:06.895042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:06.895334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:06.895558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.895686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:06.896337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:06.897216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:06.897797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.898565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:06.910738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:06.911799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 23:14:06.913343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:06.913845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:06.914900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:06.922061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 257/523] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:06.923223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.027358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eda2c7-ac9c-42c2-817e-3313eab97aa4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.030454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5550fcb-f2a8-47ed-9991-85bbef5634a2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.062861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.063587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.063868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.064139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.064839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:07.065142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.066136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.066581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.066793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.067078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.067353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.074377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.075886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:07.087905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:07.088886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:07.089712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:07.090623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 267/524] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:07.091481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.093625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 258/525] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:07.094284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.139287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.144670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.202597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da61b63d-60e1-4080-ac42-478adeee0237 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.205958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b1cd25-cecd-4f99-bc26-638d2bd2e8cc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.240217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.241387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.241673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.241942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.242672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:07.243023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.244375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.244489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.244981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.245260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.245527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.267943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 268/526] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:07.267943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.327042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.328504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.370280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.379108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a3bf25-0147-435c-89c7-d2c61a9345ba None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.389045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.419443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.420385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.420669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.420959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.421664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8ba4d7dcfc6248118c0100c91a8e0236) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:07.421973 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.423440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.429484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 269/527] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/role_assignments?user.id=8ba4d7dcfc6248118c0100c91a8e0236&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:07.430099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.438865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 259/528] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:07.440105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.549950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b298368-be49-4de0-b952-d1679f43a70d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.588809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.589333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f69ab0-9fac-4594-9c1e-5d894e1c41e6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.589528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.589751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.590022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.590864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:07.591522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.593892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.607385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 270/529] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:07.608236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.632329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.633786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.634532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.635048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.648755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.654911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.722565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daa3ae-0cd9-4b74-ae62-ddc54e1ab6af None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.729682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.731703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.770111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.771155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.772180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.772704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.787896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.790515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:07.811301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:07.812256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:07.813100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:07.813100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:07.813100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:07.815124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 271/530] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:07.816051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.862806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 260/531] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:07.863715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:07.918391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.919632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:07.951212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160dc5e-13a7-4a80-af40-e48a19f3aabb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:07.986952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:07.987260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:07.987520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:07.987790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:07.988575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=dfaa389252804cb980cf4fc92928000d) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:07.988881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:07.990628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.001829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a92be1a-30b2-4e83-83a5-afeda2198161 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.002696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 272/532] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/role_assignments?user.id=dfaa389252804cb980cf4fc92928000d&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:08.003681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.047779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.049106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.049590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.050086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.050981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:08.051485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.054068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.069506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 261/533] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:08.076624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.203299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c16343-7b1c-423b-9a5c-3c194cbea9ff None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.205685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:08.242642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e7f20d-1c2c-4a48-9587-eb765d50df83 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.249090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.250074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.251113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.251597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.259288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.261053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:08.282406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:08.283341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:08.284211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:08.292963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 262/534] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:08.300647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.326181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.326843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.327127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.327401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.344665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.346142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.356739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:08.375552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:08.376522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:08.377363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:08.377363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:08.377363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:08.383258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 273/535] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:08.384936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.461048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de9c37-d93b-4b30-8b99-611aa2ca3342 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.496392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.496925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.497209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.497489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.498192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:08.498504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.499984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.518370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 263/536] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:08.528610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.552259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d90043-0756-4ccc-92ca-729f83218552 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.579653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:08.609713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.610331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.610616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.610917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.611681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:08.611988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.613424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.626205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 274/537] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:08.631977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.709130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b49154-867c-45fe-9cf9-5dd31dfed5c2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.716681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:08.753151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.754146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.754628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.755244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.757250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8a1775415549435c96a6e22ff0fd6911) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:08.757787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.759455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b2a1fc-33b1-49d9-b12a-b2acf60c0ddf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.766482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 264/538] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/role_assignments?user.id=8a1775415549435c96a6e22ff0fd6911&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:08.803736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd7c9b-fc85-4749-86bd-a3501506d4e3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:08.865336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:08.866087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.866364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.866638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.870476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba22827-7400-4b91-9a6a-f5612c352962 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.871039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba22827-7400-4b91-9a6a-f5612c352962 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.871514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba22827-7400-4b91-9a6a-f5612c352962 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.873279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 265/539] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:08.878425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:08.879160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:08.879641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:08.879932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:08.880324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:08.906749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:08.907676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:08.908497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 275/540] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:08.917371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:08.917576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:08.917655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:09.054733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 266/541] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:14:09.124740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6725cc24-75d3-4ef5-bb92-2221d785decd None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:09.159798 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:09.182966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:09.183923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:09.184396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:09.184860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:09.185767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:09.186323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:09.188059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:09.211237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 276/542] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:09.217480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:09.255095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:09.368713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1062f4c-ed88-4074-86dc-71c8572322e0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:09.418598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:09.420130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:09.420416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:09.420690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:09.421424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=b2ddc26aee434b5d954cb42d979df7a2) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:09.421734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:09.424191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbaa3793-1c1b-4ac0-ba05-0b157c3f249a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:09.431949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 267/543] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:09 2022] GET /identity/v3/role_assignments?user.id=b2ddc26aee434b5d954cb42d979df7a2&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:09.439848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:09.574415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f029-8a22-4644-9243-71dbb3e9d64b None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:09.575517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f029-8a22-4644-9243-71dbb3e9d64b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:09.575517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e3f029-8a22-4644-9243-71dbb3e9d64b None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:09.576722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 268/544] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:09.601846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:09.602178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:09.602411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:09.652987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:09.654050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:09.659584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebe6dbd-08e7-44cf-b2a8-bf60e3f02483 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:09.719206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:09.720225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:09.720704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:09.721172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:09.739835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:09.740607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 269/545] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:09.750729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:09.751729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:09.752515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:09.755046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 277/546] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:09.760999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:09.778971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:09.888261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fbc302-8b6d-44e9-92c8-fec2cab062a5 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:09.923441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:09.924452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:09.924734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:09.925008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:09.925681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:09.925986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:09.928060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:09.938569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 270/547] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:09.944490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.015731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:10.054140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.144291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:10.160710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9bdd5f-6423-460f-bfe1-b769a3ca6b3b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:10.170950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45f9ac-8082-4dc9-bc6d-09aeed5c54fb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:10.219047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138941c-cf02-46be-947b-5977408e322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:10.219615 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138941c-cf02-46be-947b-5977408e322d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.219904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138941c-cf02-46be-947b-5977408e322d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.220182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138941c-cf02-46be-947b-5977408e322d None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.242886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138941c-cf02-46be-947b-5977408e322d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-6138941c-cf02-46be-947b-5977408e322d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:10.248110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:10.248966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:10.249750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 271/548] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:10.251138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:10.252262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.252262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.252262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.260838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138941c-cf02-46be-947b-5977408e322d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.268782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:10.270274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:10.307318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:10.310109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:10.312268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:10.312268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:10.312268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:10.312268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 278/549] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:10.315146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.459607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138941c-cf02-46be-947b-5977408e322d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:10.494773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:10.503344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:10.504392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.504686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.504963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.505976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:10.506503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:10.508113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:10.517648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:10.520651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 272/550] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:10.528689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.564642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016ec976-398a-4d8b-beda-21e7382b80d2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:10.629981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:10.630776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.631215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.631504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.632253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:10.632557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:10.633927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2aa04-28d6-4d21-8951-7723a65d867a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:10.646967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 279/551] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:10.648450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ae06-13a5-4b16-a7ee-6b8857ea4860 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.648739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ae06-13a5-4b16-a7ee-6b8857ea4860 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.649017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a33ae06-13a5-4b16-a7ee-6b8857ea4860 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.650475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 280/552] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:10.652372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ae06-13a5-4b16-a7ee-6b8857ea4860 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.653664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf49b69-34b6-4986-ace0-61ce87484921 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:10.702338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:10.703543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.704460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.704890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.720467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:10.722768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-5bada4ea-4dbd-4cc4-8424-8f46412c820c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:10.739391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:10.741169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:10.742356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:10.742356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:10.742356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:10.743711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 273/553] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:10.745063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.745393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.745767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.766301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:10.767835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:10.774020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a33ae06-13a5-4b16-a7ee-6b8857ea4860 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:10.823377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:10.829451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:10.830748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:10.831468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:10.831895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] PATH_INFO: `/v3/users/swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:10.842622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:10.845156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:10.858991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:10.859997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:10.860903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:10.861512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 274/554] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:10.861512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.863628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 281/555] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:10.873640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:10.898014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.009186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc65f711-debf-42dc-88c7-602a70c88b64 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.050558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.051992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.052285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.055785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.055785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:11.055785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.056376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.072223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397c1f6-212d-4a37-b176-2d8f1f603481 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.095297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 282/556] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:11.107784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.135628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.136243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.136519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.136787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.137434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:11.137733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.139129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.163227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 275/557] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:11.168524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.228163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.229590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.273229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b93f84-b22a-48c4-9548-ba478518b09b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.311644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e22446c-735c-4c59-8282-10279e9c141f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.314862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.315482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.315767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.316041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.347977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.348610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.349043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.349391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] PATH_INFO: `/v3/users/nova` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.357787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.359381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-934470d9-6fe2-44a3-8ec9-211dafe5d0ff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:11.371847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:11.373253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:11.374209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 276/558] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:11.375342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08c860-0ba7-4e24-ac6a-0c10fe46001a None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.375342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08c860-0ba7-4e24-ac6a-0c10fe46001a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.375342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08c860-0ba7-4e24-ac6a-0c10fe46001a None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.379029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 277/559] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:11.379029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08c860-0ba7-4e24-ac6a-0c10fe46001a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.389053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.390583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.457953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.484727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.494264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08c860-0ba7-4e24-ac6a-0c10fe46001a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.497990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 283/560] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:11.498870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.534543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21752-2a93-4471-ab68-c44752393e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.535465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21752-2a93-4471-ab68-c44752393e28 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.535893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21752-2a93-4471-ab68-c44752393e28 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.536328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21752-2a93-4471-ab68-c44752393e28 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.548005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21752-2a93-4471-ab68-c44752393e28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-25c21752-2a93-4471-ab68-c44752393e28 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:11.552823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:11.553988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:11.554865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:11.559077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 278/561] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:11.560317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.560610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.560887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.578938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:11.580119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:11.610479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eae87cd-f525-4c42-8a4f-84a2a34f3f4d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.647167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.647816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.648102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.648377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.649106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:11.649412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.650864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.654904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 279/562] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:11.655746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.667884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 284/563] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:11.668691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.695845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.758282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.772938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6c0357-9b50-4f30-aa81-d8aa95b61095 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.775782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc912f2-5d85-4a17-bcfd-12dcdf6c5978 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.809089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.809818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.810102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.810377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.811077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:11.811386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.811568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.812345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.812765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b64f48-db5c-4708-a2a5-856ee0744c2a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.812926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.813332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.821306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 285/564] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:11.822476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4ac8-c90f-40f6-8bb2-25b71154eedb None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.822792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4ac8-c90f-40f6-8bb2-25b71154eedb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.823066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308d4ac8-c90f-40f6-8bb2-25b71154eedb None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.824401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 286/565] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:11.828380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.828813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4ac8-c90f-40f6-8bb2-25b71154eedb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.830188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:11.846483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:11.847630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:11.848645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:11.848645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:11.848645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:11.850206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 280/566] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:11.851347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:11.922964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:11.937832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308d4ac8-c90f-40f6-8bb2-25b71154eedb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.964159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2380cb-bac5-49a3-a462-ab6ad5b9e46e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:11.973055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.973679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.973958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.974270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:11.983905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:11.985345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:11.997900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:11.998528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:11.998841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:11.999117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-fdac6c27-fd22-4a32-ae84-330071ca70e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:12.000054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.000977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:12.001846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:12.001846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:12.001846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:12.001846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 287/567] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.002331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.002542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.002843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.009207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.014028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.015554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.020909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:12.022954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:12.030437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.031427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:12.032326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:12.032326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:12.032326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:12.032326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 281/568] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.032326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.104278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 288/569] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:12.104278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.147926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9928fe-8bdc-4726-8364-76522fc80ebf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.167882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.186233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.187183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.187322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.187492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.188139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:12.188445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.189936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.198592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d04a140-fca1-46f8-a361-4e83c46395cb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.207623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 282/570] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:12.207623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.235329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.235961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.236246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.236524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.246389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:12.251041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.252034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 289/571] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.252921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.265397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.327357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac365eaa-7919-4d38-86f6-8fbefa889e8e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.360778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e713c-1f2b-484e-aa6c-1342e0b17c62 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.363631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.364240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.364521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.364796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.365761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:12.366070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.367504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.378924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 283/572] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:12.379738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.390051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.396435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.397123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.397414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.397688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.398333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:12.398638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.400050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.411563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 290/573] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:12.412882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.480683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98baff63-48b1-487b-9356-b52dc3d26631 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.491181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.516295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.516919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.517199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.517470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.517784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1f5b7c-6d45-48d6-8114-2851e0e30b53 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.524467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.525904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:12.537794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.538738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 284/574] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.544510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.552153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.553322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.553607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.553881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.554542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:12.554877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.556253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.564012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 291/575] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:12.564792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.620377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.638320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbe54b6-4828-42c4-9a82-c0a32af7cc03 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.668957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6715c-5f37-45cf-9e0c-9b49c8733873 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.672335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.672961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.673245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.673520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.683675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:12.688744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.689731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 285/576] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.690977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.702821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.703453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.703738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.704012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.711085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.712528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:12.723621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.725189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:12.726104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:12.726534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.726606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 292/577] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.726606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.795125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd64770c-614a-47c0-827d-e4fa06967ed2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.826222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399f288b-a8e2-4547-9ac7-b52baa2e7f0a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.828745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.829366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.829650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.829925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] PATH_INFO: `/v3/users/glance` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.837488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.838629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.838945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:12.850019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:12.851080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 286/578] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:12.852017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.863879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.864488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.864773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.865583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.866281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:12.866590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.868074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:12.879859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 293/579] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:12.881174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:12.941237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:12.951792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e068f8-e071-465f-b9bb-70da253555cd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.977558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25321aeb-f1fc-4ed4-97d6-56163d31f111 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:12.983926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:12.984548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:12.984825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:12.985097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:12.996122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:12.997551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:13.011920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:13.013020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:13.013926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:13.013926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:13.013926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:13.013926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 287/580] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:13.013926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.018912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.019525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.019808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.020081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.020748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.021082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.022422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.031172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 294/581] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.031956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.067741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.123936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a99bb-20d2-4bc8-9637-3e55d7ad9317 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.137022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374f814-43b4-4070-bc0d-a486d16105bc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.159097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.159742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.160029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.160312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.161006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.161312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.163510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.170801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.171399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.171681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.171951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.172673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.172971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.174376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.175373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 288/582] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.176177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.179518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.191832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 295/583] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.192640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.276232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07081265-c176-43b0-b012-516dcb7e9c05 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.283795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.293029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2bc651-bfbb-4f50-becd-45294320c384 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.312985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.313581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.313861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.314130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.314877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=53bb1987763944d3935ee9479b8032f3) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.315187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.316602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.322504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 289/584] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/role_assignments?user.id=53bb1987763944d3935ee9479b8032f3&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.323281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.327489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.328116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.328399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.328673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.329336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.329644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.331093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.344582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 296/585] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.345440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.412435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.450948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d109d7-9257-4cbf-9d85-2ab4baeae81d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.463809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a58cd4-e3b0-487c-b182-7fc814c3b71f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.493290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.493929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.494208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.494491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.499575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.500470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.500926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.501481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8ba4d7dcfc6248118c0100c91a8e0236/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.505133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.506613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.517469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=8ba4d7dcfc6248118c0100c91a8e0236, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.519111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:13.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:13.522216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:13.523119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:13.523119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:13.523119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:13.523119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 290/586] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:13.523357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.539122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 297/587] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:13 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8ba4d7dcfc6248118c0100c91a8e0236/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:13.540289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.543153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.675202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922b837-c910-4ca0-8968-629342fc43a7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.696212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.696555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b40720-bc32-4f23-9d35-c7e77b9053cc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.719572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.720551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.720551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.720769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.735947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.737418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.750872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.751813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.752273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.752725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:13.754330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:13.755307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:13.756430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:13.756430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:13.756430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:13.756430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 291/588] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:13.757119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.765840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.768255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:13.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:13.784233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:13.785174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 298/589] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:13.785834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.853920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:13.888487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be78316-7f5c-4cd5-bb2d-75fecb321859 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.901216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b763b37-86dc-49ee-8a8f-9ee7eb412535 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:13.926811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.927671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.928295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.928815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.929563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.929964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.931487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.938988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:13.939810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:13.940315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:13.940786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:13.941632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:13.942133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:13.944474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:13.946229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 292/590] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.946833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.960112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 299/591] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:13.961352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:13.980405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.060661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9394f1b1-600b-4bb5-b2dd-101f5c2c7213 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.065254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0216c12b-3f5d-4aef-90f7-6a9006549df6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.090201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.098443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.099087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.100102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.100537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.101530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:14.101816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.103336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.105112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.106023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.106502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.106992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.115354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.117112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.123510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 293/592] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:14.124368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:14.129878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:14.131381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 23:14:14.132440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:14.134906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 300/593] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:14.135922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.221047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.236227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736cbaa1-65b8-41fc-b0d4-e2f160fb87e3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.241323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8d113f-58d2-41f6-b7c0-2c52290bf0c7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.273090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.274338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.274627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.274928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.278120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.279042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.279525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.280000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.284887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.286449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.295229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.296943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:14.298762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:14.299639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:14.300520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 294/594] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:14.301521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:14.315799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:14.316772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:14.317657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:14.317657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:14.317657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:14.319797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 301/595] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:14.320806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.357001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.414942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65d79f1-f8c2-4985-ad67-c6a2e16b7e4d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.428589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5320fe-66e4-4900-94c4-d4fd19bf426d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.454370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.455013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.455293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.455567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.456298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:14.456602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.458248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.466436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.467368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.467855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.468330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.469223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:14.469726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.471458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.478449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 295/596] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:14.479554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.484765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 302/597] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:14.485843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.488483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.581490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.590310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087d658-f77e-43cc-a633-9050a149e070 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.596585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad18d3-58c9-4217-b20c-5302793c36cb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.625932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.627217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.627872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.628498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.637963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.638578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.638885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.639155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.639799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:14.640099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.641584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.643040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.644788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.654850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 296/598] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:14.655492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:14.660703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:14.662253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:14.663167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:14.663167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:14.663167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:14.665223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 303/599] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:14.666217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.732767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.771054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5cd318-38d2-4e21-bed2-15c4f5dc20cf None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.773703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ac146-ef8a-4df2-9c88-a4673abebab2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:14.807662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.808661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.809239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.809715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.812491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:14.813246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:14.813590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:14.813869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/dfaa389252804cb980cf4fc92928000d/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:14.818357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.820114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.830464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=dfaa389252804cb980cf4fc92928000d, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:14.832000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:14.832305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:14.833143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:14.834242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:14.837049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 304/600] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:14.838102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:14.850618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:14.857707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 297/601] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:14 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/dfaa389252804cb980cf4fc92928000d/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:14.863361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:15.049127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7dd0e9-a5f7-4cf1-90d0-736c0a94794e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.062695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b5db4-395f-4313-8fd7-17ba0b19802f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.087204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:15.101038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:15.102106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.102670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.103232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.104084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:15.104637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:15.106212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:15.107702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:15.108635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.108922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.109201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.109976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:15.110291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:15.112389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:15.122957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 305/602] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:15.126830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 298/603] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:15.132079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:15.132542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:15.213564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:15.252824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee157cf-79ff-45c7-b83e-e8b187dbe635 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.278088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a024e-ba34-4ad4-8f8f-8c57084a43a1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.298987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:15.299976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.300463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.300958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.309009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:15.310774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:15.319821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa40e1-6095-4a6e-acc9-a276532df52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:15.320487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa40e1-6095-4a6e-acc9-a276532df52e None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.320773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa40e1-6095-4a6e-acc9-a276532df52e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.321049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa40e1-6095-4a6e-acc9-a276532df52e None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8a1775415549435c96a6e22ff0fd6911/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-a6533099-b381-46b3-9970-59ae02b88de7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:15.325310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:15.326189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:15.327126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:15.333112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 306/604] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:15.335364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83e47-7bb0-4d06-b901-93c97241af5d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.335992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83e47-7bb0-4d06-b901-93c97241af5d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.336596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b83e47-7bb0-4d06-b901-93c97241af5d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.337045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa40e1-6095-4a6e-acc9-a276532df52e None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=8a1775415549435c96a6e22ff0fd6911, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:15.339752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fa40e1-6095-4a6e-acc9-a276532df52e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:15.340246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 307/605] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:15.341181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83e47-7bb0-4d06-b901-93c97241af5d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:15.359457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 299/606] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:15 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8a1775415549435c96a6e22ff0fd6911/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:14:15.367299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.368923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.369449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.407774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:15.409836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:15.454600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:15.541756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 300/607] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:15.543450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b83e47-7bb0-4d06-b901-93c97241af5d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.571354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:15.580544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:15.581168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.581454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.581738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.582665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:15.583992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:15.585455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f95ec1-0c08-479b-8d4e-ab83d5a5d334 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:15.598150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 308/608] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:15.604942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:15.640670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411c1d2-4b2e-419d-8f0b-faa8b97f81c2 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.640961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411c1d2-4b2e-419d-8f0b-faa8b97f81c2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.641248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411c1d2-4b2e-419d-8f0b-faa8b97f81c2 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.644195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 309/609] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:15.648231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.648519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.648801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.668777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:15.669988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:15.746014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bee2449-966d-4e9a-a2d2-4fbb9ab9ba7e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.761029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 310/610] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 17 23:14:15.793820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:15.794497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:15.794828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:15.795144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/b2ddc26aee434b5d954cb42d979df7a2/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:15.811850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=b2ddc26aee434b5d954cb42d979df7a2, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:15.813330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:15.828426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:15.831729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 301/611] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:15 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/b2ddc26aee434b5d954cb42d979df7a2/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:15.972280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961115c5-89cb-4d82-998a-dc301bb1670c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:15.990589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:16.009653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.010883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.011172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.011449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.022603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:16.027553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:16.028507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:16.029336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 311/612] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:16.034392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.052982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:16.100685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.224717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442bf827-6293-45ed-a5f8-9f7eb22b95a9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:16.260700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109b11b4-78d3-4733-adc8-1c2fc450e67b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:16.275719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.276684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.276971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.277246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.301153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:16.310304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:16.311281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:16.312101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 312/613] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:16.329078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.342517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.343220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.343510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.343787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.344474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:16.344780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:16.346154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:16.365441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 302/614] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:16.367838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:16.370340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.447347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac21be-779c-4597-acbe-0878948c7b85 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:16.489700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:16.529311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f875752-70fe-4e78-a9d9-7b8188c5c225 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:16.566047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.566247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.566805 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.567096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.567375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.568125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.568232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:16.568508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:16.569020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.569484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.569890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:16.581311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:16.584251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:16.589995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 313/615] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:16.599840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:16.601534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:16.602509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:16.603424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:16.603424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:16.603424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:16.605591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 303/616] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:16.616102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.708026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:16.712503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5368e491-43fe-42d7-87f0-9909c7ce7d95 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:16.786282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.787028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.787319 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.787597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.802002 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d72561-3de9-485f-9b13-74a46994549e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:16.813271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:16.814762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:16.836421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:16.837816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:16.838687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:16.838687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:16.838687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:16.844930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 314/617] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:16.845790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:16.852469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:16.875218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:16.875755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:16.876044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:16.876318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:16.876967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:16.877269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:16.878642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:16.900880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 304/618] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:16.907296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.013390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e5b05-30ea-43c7-936d-4604db850a3c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.051126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.051886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.052249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.052539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.053302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:17.053616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.055200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.071467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 315/619] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:17.074000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.098385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:17.129803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba15006d-894b-49b8-b939-6680089099d5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.175479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.176127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.176411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.176687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.190971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.192434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:17.216765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:17.217782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:17.218781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 305/620] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:17.243265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.293261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3892aec4-6b45-4ee5-adb0-ad6c4eeb3453 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.315084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:17.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.369005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.369301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.370369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] PATH_INFO: `/v3/users/nova` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.378509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.380876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-2d440b3f-a60a-4b11-a24c-958ff16165bc None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:17.395739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:17.398502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 316/621] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:14:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fe728-22c7-4f01-b48b-701dd14c0dbb None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.400735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fe728-22c7-4f01-b48b-701dd14c0dbb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.402571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fe728-22c7-4f01-b48b-701dd14c0dbb None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.402571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 317/622] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:17.408630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fe728-22c7-4f01-b48b-701dd14c0dbb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.410945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8023e1-6e8a-459a-aa56-c759013942e6 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.456392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.457009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.457291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.457567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.458838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:17.459297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.460871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b5e103-2729-4ba2-b654-02de952d4ad5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.480270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 306/623] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 17 23:14:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:17.481657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.481948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.482228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.491577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:17.503247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:17.504552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:17.525497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fe728-22c7-4f01-b48b-701dd14c0dbb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.561536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.562157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.562446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.562739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.563541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:17.563859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.565309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.583197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 318/624] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:14:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:17.584961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.587484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 307/625] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:17.588947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.647887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:17.720849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321d5b32-bfc5-4a0d-97fb-54a2be021bb6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.744661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbbd261-af8e-46a8-bd2d-e2bdce7304a9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.749190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:17.758373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.759064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.759351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.759631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.773027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.774479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-16fbd111-aec0-4438-9610-df0254178e4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:17.790941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:17.791918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:17.793457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:17.793457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:17.793457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:17.796892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 319/626] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:17.797738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.798202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec948109-7531-4e59-982d-2ab49a999ff7 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.798496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec948109-7531-4e59-982d-2ab49a999ff7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.798814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec948109-7531-4e59-982d-2ab49a999ff7 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.799248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.799721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.800204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.804365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 320/627] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:17.804365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec948109-7531-4e59-982d-2ab49a999ff7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:17.886717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.888666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.913163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec948109-7531-4e59-982d-2ab49a999ff7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:17.917705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:17.955784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:17.956877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.957164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.957619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.958313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:17.959261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:17.960746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982853fb-7e2a-422b-8be7-a4c2d78fc0f6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:17.976193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 321/628] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:17.977882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:17.978487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:17.979012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:17.997462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:17.998644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:18.007670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 308/629] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:14:18.007670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.036112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.072465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 322/630] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:18.073325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.129387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e2b2b-9d07-4b7b-a1e0-c777e302cc5b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.158203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.166938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.167498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.167776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.168047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.178970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:18.183673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:18.184593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:18.185421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 309/631] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:18.186643 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.203491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a7379-51c5-4932-98de-ce5578f7bab5 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.238890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.240047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.240344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.240620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.247259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.248707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e0a9339e-9856-41f3-91e3-9cbce9e6ff79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:18.260817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:18.261760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 323/632] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb260a7-05f4-4b5e-8ca8-b309333bc463 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.267825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb260a7-05f4-4b5e-8ca8-b309333bc463 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.268437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb260a7-05f4-4b5e-8ca8-b309333bc463 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.268437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 324/633] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:18.268437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb260a7-05f4-4b5e-8ca8-b309333bc463 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.303368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fed5f3b-5296-469d-aac2-ef921deb75d9 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.306585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.340633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.341261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.341588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.341864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.354850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.356314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:18.370150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:18.371103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:18.372018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:18.372018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:18.372018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:18.372018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 310/634] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:18.372239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.387697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb260a7-05f4-4b5e-8ca8-b309333bc463 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.413824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.421874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.422410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.422696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.423002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.423665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:18.423968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.425337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b755a978-faa8-4dd2-a6bd-e0de5e910f5f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.433355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 325/635] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:18.434570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.434890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.435167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.454031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:18.455241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:18.474429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905b3acd-39a2-4169-865c-0b4f2917e8a7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.511586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.512430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.512704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.512976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.513660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:18.513964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.515417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.524860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 326/636] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:18.525797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.533433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 311/637] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:18.533433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.557068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.636500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.639916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d7ca9-69a4-4eb6-9aa4-b4ec73e38cc2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.642353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4cc6d7-ec5a-4f9b-abd6-84ca7ff32323 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.675888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.676423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.676710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.676990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.677803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:18.677916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.678115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.678475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.678836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.679118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.679513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.689730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:18.696202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 312/638] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:18.696202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:18.699578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:18.700500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:18.701342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:18.702836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 327/639] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:18.703621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.787200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.806255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9484fb6a-1ecd-40b8-8ec3-53f6644a0973 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.807108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad43b147-2a4a-4970-ac74-ad06240f4a93 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:18.840535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.840901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:18.841203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.841479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.841619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:18.841747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/53bb1987763944d3935ee9479b8032f3/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.841874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:18.842045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:18.853222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.854677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.856343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=53bb1987763944d3935ee9479b8032f3, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:18.857776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:18.869587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:18.870747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:18.876983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:18.876983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:18.876983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:18.877157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 328/640] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:18 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/53bb1987763944d3935ee9479b8032f3/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:18.877231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 313/641] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:18.877308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.877385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:18.893663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:18.991246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1717304-2225-4918-b772-17cd674d10b2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.003205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceafa16a-f5aa-477c-97a3-0be7831be2be None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.034348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.035054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.035337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.035609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.036274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.037230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.038595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.039856 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.047641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 314/642] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:19.047793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.048295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.048420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.048761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.049043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.057625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.059484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:19.071259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:19.072243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 329/643] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:19.073131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.133987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.172835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb21339-827c-4b45-b5c6-69bd0a32b814 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.191383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d08461-f8bd-47af-80ab-78359761aa1d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.210318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.210983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.211268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.211544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.222180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:19.228234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:19.229170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:19.230067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 315/644] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:19.230903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.241753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.242309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.242605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.242932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.243593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.244030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.245314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.262415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 330/645] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:19.262415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.327628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.347880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f87e39e-28af-4fba-8636-c38ca28e4324 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.379124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ef8b1-2fd9-44a5-b8b1-41e744d9ae57 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.386083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.386730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.387021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.387412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.389666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.399403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.401881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.416326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.416939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.417225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.417503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.418204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.418516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.419977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:19.421032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:19.422372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:19.423420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:19.423420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:19.423420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:19.429875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 316/646] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:19.430905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.432167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 331/647] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:19.432983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.538246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97fb41e-e80b-4601-ae4c-d9152c643c64 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.549619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d526a-71d3-4c51-93b7-594c32df5bc1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.551088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.575475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.576316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.576740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.577183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.585866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.586085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.586471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.586782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.587065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.587738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.588048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.588475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.589401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.603873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 317/648] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:19.603873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:19.604105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:19.604975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 332/649] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:19.605920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.659584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.712084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f8e4e-c08e-4888-bf42-5cfad1681e85 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.721749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff457d2-56c8-4f50-b6b3-54f67cceb9e8 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.748664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.749270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.749551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.749823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.750458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.750794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.752154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.758807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.759650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.759930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.760243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.760972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8ba4d7dcfc6248118c0100c91a8e0236) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.761280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.762692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.769332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 318/650] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:19.769332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.769556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 333/651] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/role_assignments?user.id=8ba4d7dcfc6248118c0100c91a8e0236&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:19.769556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:19.827972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.893791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6127b47-0a32-4586-9e98-480d7b276c63 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.906476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:19.928401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd5f90a-27e0-431c-acef-d0b022cf03e6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:19.941475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.943219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.943791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.944337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.955833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.957827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.980694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:19.981409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:19.981775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:19.982130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:19.982989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:19.983371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:19.984874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:19.986491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:19.987421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:19.988308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:19.988308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:19.988308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:19.988992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 319/652] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:19.990426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.011165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 334/653] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:20.013553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.122933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc101aa-f9d2-4e83-95c2-60addada22ed None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.134638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.144142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67398dc-b713-4efa-b500-ca19a071e61a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.170879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.172026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.172479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.173115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.184586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.186131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.186759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.186898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.187087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.187337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.187991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:20.188297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.190626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:20.201836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:20.202855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:20.203791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 320/654] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:19 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:20.204859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.205004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 335/655] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:20.210963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.228578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.314733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4694d-b0ad-4286-9b11-ee831abf1b1b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.322389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c92bd85-3a79-4f48-b861-2045cb69c2fe None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.350821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.351438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.351723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.351998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.358790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.359414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.364062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.366238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.368332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:20.368726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.370542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.395180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 336/656] 10.222.0.39 () {56 vars in 1137 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:20.396542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.412872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.434982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.436437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.457807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.510454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4351ae-726a-4cb1-9a47-88cb0bcbe2fb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.546664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 321/657] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:20.547984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.558726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.559370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.559650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.559924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.567504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.569995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:20.582046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:20.583117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 17 23:14:20.584897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:20.588633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 337/658] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:20.589507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.663635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e080a-0a95-49b9-ad88-e015060e1748 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.665658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.685948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.699455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3caee27-eea8-4ca7-b3bd-3b2d57bc0e40 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.703234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.704091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.704601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.705081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.735317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.735953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.736273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.736506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.748045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.749823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:20.764720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:20.765704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:20.767243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:20.767243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:20.767243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:20.767243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 338/659] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:20.767243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.781705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.783515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.885756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389b5aa7-e4b0-4543-8f3c-bb4bea6bef74 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:20.893688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 322/660] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:20.893688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:20.912895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.915842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:20.929680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:20.930303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.930588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.930896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.931636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:20.931943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:20.934090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70437ecf-782b-4544-8789-e258186e4945 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:20.951608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 339/661] 10.222.0.39 () {56 vars in 1139 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:20.952939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c105-ec38-44c9-96aa-2dd58d0a8c3a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:20.953287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c105-ec38-44c9-96aa-2dd58d0a8c3a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:20.953565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca7c105-ec38-44c9-96aa-2dd58d0a8c3a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:20.955163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 340/662] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:20.956173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7c105-ec38-44c9-96aa-2dd58d0a8c3a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.016149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a454c7-dce6-4dd5-8bab-b8d68121c21c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.057133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.058388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.058922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.059606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.060579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:21.060789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.062224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.074144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca7c105-ec38-44c9-96aa-2dd58d0a8c3a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.085554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 323/663] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:21.085554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.117742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.118392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.118677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.118994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.137196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.139088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-30e23a93-5439-4edc-a4b7-9e2dfb8f6a78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:21.156662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:21.157844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:21.158858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:21.158858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:21.158858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:21.158858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 341/664] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:21.161463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.161992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.163029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.186039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:21.187815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:21.199315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:21.221613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e759914-362c-4f35-b236-40c847ffca65 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.227999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:21.273151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.277058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.277058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.277058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.283831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 342/665] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:21.284912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.373016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.375974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.410023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f67c58-63b4-4021-81c6-065e585eff02 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.451200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.451761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.452045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.452321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.464712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.466180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.479306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:21.479817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:21.480664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 343/666] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:21.482184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.509301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 324/667] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:21.510593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.530721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:21.623172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7e58f4-cbfb-4fbe-8863-f9eade566c09 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.623872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2d1c8c-bebe-4834-bc1c-cc34cff39cc5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.667781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.668408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.668697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.669052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.669715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:21.670025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.671486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.672089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.672707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.673223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.673506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.674210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:21.674516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.675981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.685925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 344/668] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:21.687082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.694393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 325/669] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:21.695666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.750184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:21.801552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:21.821924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761a0a16-036d-4bc3-a9df-1978b1d8cd76 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.822128 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6b7f47-65ee-44d5-8a62-bbf1f7c7f41c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:21.866597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.867263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.867710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.868029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.868137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:21.868820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:21.869108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:21.869385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:21.880891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:21.881100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:21.882939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:21.886125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:21.887477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 326/670] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:21.888838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:21.910312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:21.912101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:21.913857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:21.913857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:21.913857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:21.917465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 345/671] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:21.918312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.014382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.017180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08655a05-12d1-4e69-9956-db7fbab7ebb7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.035351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638747d-69cd-40d1-8561-b4595359c2c9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.050791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.051419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.051700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.052616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.059199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.060633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.069485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.070088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.070374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.070652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.071416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=dfaa389252804cb980cf4fc92928000d) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.071734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:22.072199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:22.073181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:22.074133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:22.074590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.075348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 327/672] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:22.075348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.077111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.080583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 346/673] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:21 2022] GET /identity/v3/role_assignments?user.id=dfaa389252804cb980cf4fc92928000d&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.082259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.189394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0760521-46ec-44e7-b6da-730050bfabb2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.196669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d684c1-2a1b-4ef1-90b2-d6e8ddb50f5c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.228934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.229645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.229926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.230205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.231271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.231271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.232544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16b8cf8-44ca-4d73-a17e-dd6342f035df None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.241420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.242495 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.242820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.243107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.244525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.244525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.245515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.246829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 347/674] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.247660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9923-d161-4c73-8190-02d8af3ae56f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.247950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9923-d161-4c73-8190-02d8af3ae56f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.248224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41a9923-d161-4c73-8190-02d8af3ae56f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.255577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 348/675] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:22.255577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9923-d161-4c73-8190-02d8af3ae56f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.255819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 328/676] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.256656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.283272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.329143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.374412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80581e4-debd-4455-840f-102b4feeec63 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.376184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41a9923-d161-4c73-8190-02d8af3ae56f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.410933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.411731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.412261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.412367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.412590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.412697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.412865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.412957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.413597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.413908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.415369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472c059-2452-492b-8b14-6179dc4e5421 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.420519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.421933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.432749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 349/677] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.432749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.432749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.432749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:22.438679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:22.439567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:22.440429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:22.444844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 329/678] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:22.445717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.448095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:22.449912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:22.526749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 350/679] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:22.526749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.539503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.559117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575f509-bf23-4239-8eb4-95505b00386c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.596180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.599435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.600798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.601189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.601466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.615833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.618189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:22.636406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:22.637386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:22.638541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:22.638541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:22.638541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:22.638541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 330/680] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:22.639569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.657816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3109b9d-9028-4c88-95ed-538f4fa52a30 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.702772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.703405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.703686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.704199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.705296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8a1775415549435c96a6e22ff0fd6911) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.705625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.707378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.716301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 351/681] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/role_assignments?user.id=8a1775415549435c96a6e22ff0fd6911&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.717114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.782630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bf9976-67eb-47c8-9e91-5c6a2d9e1e22 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.842527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.843101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.843384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.843659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.844471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.844786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.846425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.860840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.861211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 331/682] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.867286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.883378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d174ce31-fbdb-45dc-9707-fc69bc6b423b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:22.899341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:22.921952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:22.922569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:22.922915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:22.923194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:22.923852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:22.924159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:22.925538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:22.938914 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 352/683] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:22.939621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:22.989406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0052f4bc-48e0-4129-9ba8-64772345ea9c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.034270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.034944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.035226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.035498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.046774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:23.051479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:23.053839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 332/684] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:23.055939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.057742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94357d-055d-48e2-be75-847f18fb1342 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.096497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.097254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.097425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.097685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.098421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=b2ddc26aee434b5d954cb42d979df7a2) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:23.099654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.101287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.108931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 353/685] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:22 2022] GET /identity/v3/role_assignments?user.id=b2ddc26aee434b5d954cb42d979df7a2&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:23.109851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.116633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.158198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.168286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf51bd5-5f6d-4c4a-9cf5-c49ee915ee2f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.205569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.206223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.206508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.206825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] PATH_INFO: `/v3/users/swift` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.215946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.217404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:23.229816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:23.232233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:23.234425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 333/686] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:23.235323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c4efd8-3bf6-4f06-8932-cf913c35714b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.247946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.272430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.273060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.273344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.279673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.280493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:23.280839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.282481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.298026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 354/687] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:23.303658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.385063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47953cd2-d3fe-414c-b9e4-652512759874 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.404232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.431157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.431770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.432048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.432316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.433096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:23.434447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.435941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.447763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.453412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64a52b3-4919-4d58-ad3b-a25b889272f2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.455619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 334/688] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:23.461993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.509464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.510302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.510821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.511285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.524056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.525574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:23.541677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:23.542678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:23.543946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:23.543946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:23.543946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:23.543946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 355/689] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:23.552440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.614372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb9a8c0-79d6-41ea-b484-277d50d73841 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.660327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.660854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.661731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.662018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.707212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.736440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.737944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.804915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380e0261-1af4-41cc-9296-4db9335db3e2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:23.842516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 335/690] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:14:23.848077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.878828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:23.879574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:23.880398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:23.880975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:23.881842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:23.882152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:23.883658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:23.911748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 356/691] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:23.917302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:23.938551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.952544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:23.974860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7094e57e-c04f-427c-9049-488ff5f52fcd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.015520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.016159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.016439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.022442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.043380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:24.044835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:24.071240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:24.072231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:24.074422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:24.074422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:24.074422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:24.074422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 336/692] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:24.080448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:24.112956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882254ce-d6c9-485c-8b44-486612c3d7b7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.148462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.149251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.149538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.149813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] PATH_INFO: `/v3/users/nova` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.157976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:24.159484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:24.172482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:24.174724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:24.177574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 357/693] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:14:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:24.182739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:24.283096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:24.297960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99058592-c185-4192-9fda-8684b9b84730 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.335792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.336538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.336832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.337109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.337851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:24.338409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:24.340341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:24.348793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ebd33-1069-4374-926b-2bf3c5722e0c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.360652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 358/694] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:14:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:24.366602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:24.401548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:24.433382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.434552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.434874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.435150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.435808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:24.436111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:24.437494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769b51f-0a80-4d82-8063-dd39d836e903 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:24.454297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 337/695] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:24.456129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345193-b53e-4b84-b399-8a9fcdb5eb50 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.456422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345193-b53e-4b84-b399-8a9fcdb5eb50 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.456699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87345193-b53e-4b84-b399-8a9fcdb5eb50 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.462719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 338/696] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:24.463523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87345193-b53e-4b84-b399-8a9fcdb5eb50 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:24.484111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5287c92-08c6-40d0-9d34-142763e90d11 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.521052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:24.530825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.531448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.531732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.532008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.592767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87345193-b53e-4b84-b399-8a9fcdb5eb50 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.634001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:24.635501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:24.637607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.639080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.639360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.639632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.650110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:24.652107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-351df80e-8ab9-41ca-85b3-39f8e2a3e31f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:24.668562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:24.669463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:24.670351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:24.670809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 339/697] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:24.674727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:24.674727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:24.674727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:24.696997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:24.698834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:24.748258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 359/698] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 17 23:14:24.749121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:24.753166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:24.790310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:24.795803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 340/699] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:24.796829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:24.926253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d209a19d-0c65-4c48-85ba-5a9cbfe7af54 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.995856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d80eea-63a8-4ea7-96da-cd7e33ebbc71 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:24.999063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:24.999739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.000020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.000290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.001827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:25.002135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.006580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.029752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 360/700] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:25.035351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.059065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.059713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.059999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.060278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.070532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.072016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-ee152c98-04a9-42bc-ba1c-fa0bed89c494 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:25.087226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:25.088227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:25.089151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:25.089151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:25.089151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:25.089151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 341/701] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:25.089993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5e177-fa66-4187-b4c7-7bec26364d16 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.090283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5e177-fa66-4187-b4c7-7bec26364d16 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.090559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf5e177-fa66-4187-b4c7-7bec26364d16 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.095961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 342/702] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:25.096852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5e177-fa66-4187-b4c7-7bec26364d16 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.124998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.139404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.151463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824e732-08de-4743-a6cd-1e5c010100e1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.186492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.187157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.187436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.187709 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.188436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=53bb1987763944d3935ee9479b8032f3) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:25.188733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.190161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6280688-b9e0-4c8b-8f69-c69881144bd2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.206187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 361/703] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/role_assignments?user.id=53bb1987763944d3935ee9479b8032f3&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:25.206187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.206187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.206187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.218299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf5e177-fa66-4187-b4c7-7bec26364d16 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.222833 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:25.225159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:25.269219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.270239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.270957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.271530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.272485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:25.273031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.274642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.292525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 343/704] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:25.294000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.324911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 362/705] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:25.325889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.406521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.429565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7dae7-35ac-432e-8999-f0fb04fc9998 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.447964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.472083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f84ccc-f173-4c1e-bd3c-e872afe1e284 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.475988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.476621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.476899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.477169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.488837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.490934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-36cc4a73-edad-4de9-9943-38841d5cc210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:25.509355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:25.510394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:25.511456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:25.511456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:25.511456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:25.511456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 344/706] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:25.512474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aade812-77c7-42d6-b993-7fb8f14d2ba2 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.512758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aade812-77c7-42d6-b993-7fb8f14d2ba2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.513033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aade812-77c7-42d6-b993-7fb8f14d2ba2 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.514623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 345/707] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:25.519758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aade812-77c7-42d6-b993-7fb8f14d2ba2 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.649791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.650717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.650924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.651404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.658951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.659129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aade812-77c7-42d6-b993-7fb8f14d2ba2 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.660528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-fffe0e99-9134-4d47-bbd4-ac34442dd094 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:25.672601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:25.673537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 363/708] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.675470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.676075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.693899 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:25.695098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:25.701322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.701939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.702236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.702499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.703191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:25.703497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.704906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.713681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.719779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 346/709] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:25.720625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.768600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 364/710] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:25.769918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.838271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195bbf6f-bb2e-4e6c-b332-9f44373e58ef None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.873818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.874182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.874852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.875135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.875409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.875997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.877358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:25.889877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:25.891022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:25.891879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:25.895068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 347/711] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:25.896475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:25.916645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1728a1-050b-45ed-8e54-3eaa5d500769 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:25.962297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:25.962940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:25.963220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:25.963493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:25.964294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:25.964599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:25.966134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:25.967332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:25.979971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 365/712] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:25.980813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:26.014965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb6dd3-1136-4827-a738-23d110b03398 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.051012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.052275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.052639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.052916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.053553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.055030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.080688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 348/713] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:14:25 2022] POST /identity/v3/users => generated 254 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:26.081694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:26.102463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b703-f162-407a-a555-32c3f47f26b1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.142395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.143097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.143343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.143618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.144282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:26.144679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.146324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.148029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:26.152799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 366/714] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 17 23:14:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:26.158433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:26.241000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c68c0cb-6d9e-4129-80b8-6c7bd6eb45a8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.263866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:26.279332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86182ae5-528f-41fb-a094-1fbe80fd5880 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.304751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.306047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.306047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.306047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.306537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8ba4d7dcfc6248118c0100c91a8e0236) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:26.307441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.308888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.318141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 349/715] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:26 2022] GET /identity/v3/role_assignments?user.id=8ba4d7dcfc6248118c0100c91a8e0236&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:26.318877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:26.344704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.345362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.345649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.345927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] PATH_INFO: `/v3/services/network` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.346522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.347948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:26.368197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:26.369242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:26.370102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:26.374283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 367/716] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:26 2022] GET /identity/v3/services/network => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:26.375808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:26.462211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d363b-7fd4-4196-bce7-49d7ba3d0d5b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.494985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:26.502980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.503702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.503991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.504269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.505481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:26.505792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.507198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.514492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 350/717] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 17 23:14:26 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:26.555179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7deee41-d5e2-458b-84b4-9cc6766c6335 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.598729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.599460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.599745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.600029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.600777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] RBAC: Adding query filter params (name=network) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:26.601093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.602824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9962f6c2-786b-4baf-912b-0bb4e70ab5d7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.609214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 368/718] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:26.615004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:26.682862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:26.759662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f47efa-e731-488c-a203-a056cd1c5c74 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:26.804703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:26.805376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:26.805607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:26.805881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:26.806525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] RBAC: Adding query filter params (type=network) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:26.806856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:26.808229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c188973-a985-4114-adfd-f680b5a06cda None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:26.819213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 351/719] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:26 2022] GET /identity/v3/services?type=network => generated 124 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:27.668621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14dde1-1ffa-4bc5-859b-3bc403addedf None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:27.669129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14dde1-1ffa-4bc5-859b-3bc403addedf None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:27.669129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14dde1-1ffa-4bc5-859b-3bc403addedf None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:27.670640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 369/720] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:27.676224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:27.677171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:27.677449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:27.703346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:27.704541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:27.805316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 352/721] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:28.174825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14dde1-1ffa-4bc5-859b-3bc403addedf None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:28.286429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14dde1-1ffa-4bc5-859b-3bc403addedf None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:28.313609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:28.324307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:28.324944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.325228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.325507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.336330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:28.341021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:28.341967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:28.343246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 370/722] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:28.348226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:28.408499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:28.472513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754cdfb3-69d5-4d53-924e-14879c91a76b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:28.513716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:28.514329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.514612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.514907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.515580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:28.515885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:28.517244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d8e20c-1f81-467b-addc-678cfb2d7338 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:28.527299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 353/723] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:28.532554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:28.646855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8379a356-b49c-4a1b-b987-6a48421d9f1a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:28.682173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:28.682994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.683160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.683367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.693702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:28.695199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:28.706240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875df25d-be4c-4cfc-864d-c6a506697137 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.706768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875df25d-be4c-4cfc-864d-c6a506697137 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.706849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875df25d-be4c-4cfc-864d-c6a506697137 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.709072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 354/724] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-ca7b1b48-3766-4d68-982d-14bd2e85a33f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:28.712049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:28.712998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:28.713966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:28.713966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:28.713966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:28.713966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 371/725] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:28.719601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb094b-7f4b-40e9-8594-8f18d88083c8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.719890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb094b-7f4b-40e9-8594-8f18d88083c8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.720166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbb094b-7f4b-40e9-8594-8f18d88083c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.721040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875df25d-be4c-4cfc-864d-c6a506697137 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:28.755187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-3cbb094b-7f4b-40e9-8594-8f18d88083c8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:28.756382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3cbb094b-7f4b-40e9-8594-8f18d88083c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:28.808983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:28.851390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 372/726] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:28.853016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132a5e9-5666-4701-bb06-9a09dee772e3 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.853309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132a5e9-5666-4701-bb06-9a09dee772e3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.853591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a132a5e9-5666-4701-bb06-9a09dee772e3 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.859062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 373/727] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:28.859062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa79f10-627f-4f03-a26f-b561a9155a9c None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.859062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa79f10-627f-4f03-a26f-b561a9155a9c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.859062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa79f10-627f-4f03-a26f-b561a9155a9c None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.862423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 374/728] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:28 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:28.863639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.863928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.864252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.885356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875df25d-be4c-4cfc-864d-c6a506697137 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:28.886344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:28.887734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:28.893385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:28.933100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:28.934010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.934476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.935219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.936938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:28.937460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:28.939062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad05792-2fed-40ea-8cff-9113fe8881a5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:28.954679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 355/729] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:28.956783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:28.957256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:28.958007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:28.978745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 375/730] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:28.978745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:28.994322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:28.995533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:29.128170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 356/731] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:29.136311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.140394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2169fa9-9b7c-483d-9bb1-7a2eaedca748 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.155054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.215314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.215952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.216231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.216501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.229910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:29.231448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:29.244644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:29.245615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:29.246559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 376/732] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:29.257130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.313283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.323817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcfa4ca-02b3-446e-807a-01f41653ce58 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.358834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f19ce9-32f8-4a0a-b8ff-7d09773f30b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.359466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19ce9-32f8-4a0a-b8ff-7d09773f30b0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.359744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19ce9-32f8-4a0a-b8ff-7d09773f30b0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.360015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f19ce9-32f8-4a0a-b8ff-7d09773f30b0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.371590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f19ce9-32f8-4a0a-b8ff-7d09773f30b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f8f19ce9-32f8-4a0a-b8ff-7d09773f30b0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:29.378295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:29.379249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:29.380383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:29.382533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 357/733] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:29.382847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af71318d-e6a7-45c7-bf19-afe8f5f12ee2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.384021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29145a1-7aa5-415d-9467-b875b8719209 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.384451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29145a1-7aa5-415d-9467-b875b8719209 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.384853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29145a1-7aa5-415d-9467-b875b8719209 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.386475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 358/734] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:29.387621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29145a1-7aa5-415d-9467-b875b8719209 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.428607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.429219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.429500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.429771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.430501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:29.430834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:29.432668 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:29.451116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 377/735] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:29.451928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.468778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.493793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29145a1-7aa5-415d-9467-b875b8719209 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.528750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc30ad16-7080-4f7b-a0b7-d6d2656a9299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.529374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30ad16-7080-4f7b-a0b7-d6d2656a9299 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.529658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30ad16-7080-4f7b-a0b7-d6d2656a9299 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.529941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc30ad16-7080-4f7b-a0b7-d6d2656a9299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.539939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc30ad16-7080-4f7b-a0b7-d6d2656a9299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-fc30ad16-7080-4f7b-a0b7-d6d2656a9299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:29.544610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:29.545660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:29.546513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 359/736] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:29.548433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a88fd4-3c56-45cd-9ec7-242f687b2dcd None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.551964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.552252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.552532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.570180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:29.571413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:29.578730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.583129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.583738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.584025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.584303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.584972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:29.585282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:29.586653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:29.595529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 378/737] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:29.596316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.646540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 360/738] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 17 23:14:29.647349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.680252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.706747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bac65f-6bc7-4ee7-b4a0-4b005277067a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.742288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.742932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.743227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.743489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.744161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:29.745992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:29.756227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f8c86-634e-4be8-b473-ca3da649b997 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.770943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 379/739] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:14:29 2022] POST /identity/v3/services => generated 251 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:29.770943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:29.804044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011e42a-4650-401d-8640-93a124632075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.804671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011e42a-4650-401d-8640-93a124632075 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.804956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011e42a-4650-401d-8640-93a124632075 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.805233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2011e42a-4650-401d-8640-93a124632075 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.825519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.890821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011e42a-4650-401d-8640-93a124632075 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:29.892653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2011e42a-4650-401d-8640-93a124632075 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:29.926231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b2d50-1d8d-42ce-9966-f189b3d19b75 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:29.969759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:29.970386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:29.970673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:29.971000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:29.971685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:29.971996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:29.973925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:29.979437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:29.988198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 380/740] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:29.988198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.017982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 361/741] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 17 23:14:30.018883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011e42a-4650-401d-8640-93a124632075 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.069818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:30.109175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48903d5f-3ffc-4244-83bc-16589a717e76 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.140768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2011e42a-4650-401d-8640-93a124632075 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.145629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.146283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.146571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.146893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.157764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.159255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:30.174087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:30.175076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:30.175955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:30.175955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:30.175955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:30.175955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 381/742] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:30.175955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.189168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.190280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.190565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.190975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.191860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.194416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.214100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 362/743] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:14:30 2022] POST /identity/v3/services => generated 240 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:30.214871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.239902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:30.320015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e9bfa5-9844-4877-8733-d7c861a3af91 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.352364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:30.364733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded4e37a-63da-4ad8-bcf2-ef7f43693af5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.376408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.377346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.377761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.378015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.391029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.392466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.409706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.410342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:30.410450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:30.412142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:30.413032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:30.413032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:30.413032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:30.413202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.413202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.413337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 382/744] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:30.413415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.429315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.438901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:30.456338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:30.457304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:30.458321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:30.458321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:30.458321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:30.458321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 363/745] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:30.459228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.528770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9bfce2-2a82-483a-a35a-46f7ce9c6c5b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.532138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:30.573924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.574871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.575215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.575612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.576531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:30.576938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.578472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.591558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 383/746] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:30.592635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.600875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8f803-7ec3-43cd-b6b1-d9367dbb3d85 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.657364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.658495 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.658947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.659756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.660894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:30.661347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.663586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.684436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 364/747] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:30.684436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.696947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:30.714216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82de7f3a-e984-4a3a-baf6-423d761daf77 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.753729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.754690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.755181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.755747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.756701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:30.757292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.758967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.773394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 384/748] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:30.774517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.807427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:30.827889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfbc11c-65e4-4d22-8575-b66c3aba3c04 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.875565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.876663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.877014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.877358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.887419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.889927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.895796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cced7e-5ce6-417e-b576-e25e3bf7540a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:30.906332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:30.907475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:30.908414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:30.911159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 365/749] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:30.912379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.940247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:30.940984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:30.941360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:30.941934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:30.952502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:30.953959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:30.969404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:30.970376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:30.971351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:30.974785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 385/750] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:30.975878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:30.990378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.029861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c29f9e-e083-4711-b9e5-ab8a7230ebfa None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.065656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.066667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.067316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.067818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.075210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.076981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.082016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:31.091987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:31.092896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:31.093846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:31.096636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 366/751] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:31.097650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.099485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba5bc3d-831e-4c65-b927-e12ce1ecd783 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.137941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.139055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.139645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.140125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.141073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:31.141584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.143486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.165683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 386/752] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:14:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:31.166831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.217301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baab72f-64f6-49c5-8f62-0ef655cc0797 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.245847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.258134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.259077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.259600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.260180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.261116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:31.261645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.263542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.284226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 367/753] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:31.285464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.303406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef76b5f-e7cd-4965-a7e5-2ec29013da26 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.347202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.347823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.348103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.348978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.350227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:31.350538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.352595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.368260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 387/754] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:31.369388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.372522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.410060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d3709-2042-4266-929a-a4d403348799 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.456612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.457726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.458178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.458642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.471157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.473005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.485984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18edec26-11e7-4244-b969-a802f3127ea3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:31.492174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:31.493132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:31.494052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:31.494052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:31.494052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:31.494052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 368/755] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:31.494726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.540464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.541418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a07d8-2d91-40f8-9588-d070d61a22e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.542076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a07d8-2d91-40f8-9588-d070d61a22e6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.542366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a07d8-2d91-40f8-9588-d070d61a22e6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.542751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a07d8-2d91-40f8-9588-d070d61a22e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.618977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66383593-1dfd-463c-b830-bbb417603f02 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.632647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a07d8-2d91-40f8-9588-d070d61a22e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.634392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a07d8-2d91-40f8-9588-d070d61a22e6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.637053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.659867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.660901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.661429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.662003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.663020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=53bb1987763944d3935ee9479b8032f3) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:31.663572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.665327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.672193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 369/756] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/role_assignments?user.id=53bb1987763944d3935ee9479b8032f3&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:31.673362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.805830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 388/757] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:14:31.812409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0665-d519-4754-9e69-4663f1d4ff85 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.813042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0665-d519-4754-9e69-4663f1d4ff85 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.813528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1f0665-d519-4754-9e69-4663f1d4ff85 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.815443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 389/758] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:31.817240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f0665-d519-4754-9e69-4663f1d4ff85 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:31.851802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.856522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee0d514-4983-414d-b1f4-fda0c17f9422 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.900325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.901208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.901503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.901783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.902734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:31.903952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:31.905377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1d8af7-d485-48a3-a065-468670d106bc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:31.922004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 370/759] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:31.924352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.924816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.925239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:31.948625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1f0665-d519-4754-9e69-4663f1d4ff85 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:31.949351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:31.950866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:31.951063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:31.996886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:31.997533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:31.997889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:31.998173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.011448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.013617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.031305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 371/760] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:32.032397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:32.033235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:32.034373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:32.035490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:32.035490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:32.035490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:32.035490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 390/761] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:32.054725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.222448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843c5cda-9187-4756-85e2-9696e3702b97 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.226400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:32.243765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddbb5e6-a035-4183-b461-e7cef619df3b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.285144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.285998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.286524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.286939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.287711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:32.289366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.290888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.309546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 391/762] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:32.314901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.315556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.315670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.315884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.316166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.326447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.327946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.335135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:32.340415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:32.341463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 372/763] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:32.342375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.433117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6481961-a53e-4218-a22c-fa1f72e0fbcd None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.447048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ffed97-d8dd-4c82-99d6-8bb0152e80a0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.471220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.471847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.472130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.472405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.479372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.480752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.481396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.482024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.482314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.482595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.483238 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.484595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-7c30a83c-3e7c-474c-a2fe-f708c3868c6f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:32.492459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:32.493362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:32.494244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 392/764] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:32.495194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bbd9-bd26-42c2-beb6-324df9ab707d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.495455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bbd9-bd26-42c2-beb6-324df9ab707d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.495694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1020bbd9-bd26-42c2-beb6-324df9ab707d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.498813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 393/765] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:32.498813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bbd9-bd26-42c2-beb6-324df9ab707d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:32.499011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:32.504684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:32.505832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 373/766] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:32.506771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.517898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:32.584894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:32.616034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1020bbd9-bd26-42c2-beb6-324df9ab707d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.618351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc850de1-5fa4-47cd-a9dd-6b34fa0d61e4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.652544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.653155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.653438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.653713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.654411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:32.654741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.656234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cabfa80-d3d5-4575-b472-57b7bda9cc55 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.656513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.657110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.657389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.657770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.658343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:32.658649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.660083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.673193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 394/767] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:32.673193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.673193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.673193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.682291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 374/768] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:32.682291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.694762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:32.696040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:32.759843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:32.774959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 395/769] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:32 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:32.775935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.793138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46be2c6-7f29-4425-a569-7e257d36cc5e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.832232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.833466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.833746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.834152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.834848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:32.835473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.836618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.841745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:32.847742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 375/770] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:32.848891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.884613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc985-865f-4b6c-bf8f-b5b8e1cd6af1 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:32.921444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:32.922160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:32.922446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:32.922733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8ba4d7dcfc6248118c0100c91a8e0236/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:32.925170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=8ba4d7dcfc6248118c0100c91a8e0236, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:32.926365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:32.947360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 396/771] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:32 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8ba4d7dcfc6248118c0100c91a8e0236/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:32.947360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:32.997108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659f25e6-ec67-44b5-9cc3-8fa08ca915e0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.062027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.062657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.062954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.063224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.064061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=256d6e0dec3d4855a539044716650173) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:33.064373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.065956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.073122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 376/772] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/role_assignments?user.id=256d6e0dec3d4855a539044716650173&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:33.073994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:33.077188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:33.086027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8834a7-7ba1-44c5-bdcc-ef493dee276c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.115078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:33.127503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.128200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.128956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.129606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.130572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:33.131433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.132861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.140201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 397/773] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 17 23:14:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:33.149125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:33.205459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1dc3ee-2e23-4aed-a973-f2895c56112e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.256321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.257372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.257854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.258323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] PATH_INFO: `/v3/services/network` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.259175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.260796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:33.275699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:33.276999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:33.277821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:33.280353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 377/774] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:33 2022] GET /identity/v3/services/network => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:33.286984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:33.312909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ec4d0d-c00e-43ee-bebc-c3dad3a7daeb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.365422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.366048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.366336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.366612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.367363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] RBAC: Adding query filter params (interface=public, service_id=487f9745aaa84357902c1704328d099b, region_id=RegionOne) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:33.367677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.369600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.384611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 398/775] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:14:33 2022] GET /identity/v3/endpoints?service_id=487f9745aaa84357902c1704328d099b&interface=public®ion_id=RegionOne => generated 194 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:33.386071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:33.429596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:33.462312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:33.513870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2204e-afe4-4243-8a0e-36af6f20c91a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.555399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c89367-b910-4f9d-b1f8-88dc79f4b585 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.595309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.595825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.596108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.596381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.597406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] RBAC: Adding query filter params (name=network) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:33.597715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.602946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.616224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 378/776] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:33.621847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:33.623736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.624606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.625017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.625418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.626161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.627721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.641779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 399/777] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:14:33 2022] GET /identity/v3/services => generated 772 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:33.741829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc94a97-676e-4e87-89c6-c7e6dd786388 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.773223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:33.780265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:33.781772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.782081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.782362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.783047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] RBAC: Adding query filter params (type=network) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:33.783356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:33.784740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732edd91-eee0-477b-8169-5adbce3b72fc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:33.790512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 379/778] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:33 2022] GET /identity/v3/services?type=network => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:33.796445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:33.859360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e7ec-6abc-43cb-b68d-50238d1791f8 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.859967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e7ec-6abc-43cb-b68d-50238d1791f8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.860438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b2e7ec-6abc-43cb-b68d-50238d1791f8 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.862489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 380/779] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:33.870977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:33.871264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:33.871539 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:33.898138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:33.900433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:33.962863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a5492-fd47-42ce-a00b-d68ecd88b220 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:33.983264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:34.008584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 381/780] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:34.010464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:34.011111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:34.011394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:34.011662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:34.012368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] RBAC: Adding query filter params (interface=public, service_id=7ac8b062b65e4eb4accb52696de919fc, region_id=RegionOne) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:34.012673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:34.014084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:34.023828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 400/781] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:14:33 2022] GET /identity/v3/endpoints?service_id=7ac8b062b65e4eb4accb52696de919fc&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:34.029198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:34.179012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f89bcc-63a2-46c9-a44f-a70efa09619c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:34.214035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:34.233273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:34.233887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:34.234169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:34.234441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:34.235072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:34.236431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:34.242150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 382/782] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:14:34 2022] GET /identity/v3/services => generated 772 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:34.459254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:34.579388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ca927d-6332-45e8-8f3b-7ec1e40fdcf4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:34.621226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:34.621862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:34.622193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:34.622469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:34.633798 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:34.639025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:34.639938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:34.640823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 401/783] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:34.647021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:34.752696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4cda23-4653-40a9-b1ac-fde5c46c9fc7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:34.789086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:34.789744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:34.790022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:34.790293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:34.791041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:34.791340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:34.792702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:34.802241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 383/784] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:34.807990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:34.851908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:34.924914 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5efa8c-776a-429a-ad6b-7a7369ad3a17 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:34.988377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:34.989751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:34.989867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:34.990147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.001605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:35.003163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:35.023705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:35.024686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:35.025596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:35.025596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:35.025596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:35.029654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 402/785] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:35.031781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:35.100715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:35.153821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52034d-cdb3-48fd-a9d8-950b4fbde39e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:35.189624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:35.190234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.190511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.190811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.191456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:35.192336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:35.194185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3e351c-871c-4520-b556-9ca81858819f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:35.207287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 384/786] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:35.213579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:35.355013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:35.363839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a44da-89cb-4450-ab9e-83a9e2604bdc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:35.413174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3de03-7019-46f3-b2c2-aac5d5e1bf74 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.413533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3de03-7019-46f3-b2c2-aac5d5e1bf74 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.413773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f3de03-7019-46f3-b2c2-aac5d5e1bf74 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.415133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 385/787] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:35.415371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:35.416016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.416290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.416558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] PATH_INFO: `/v3/users/swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.420107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d73d-9154-425f-a871-c1f074368964 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.420383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d73d-9154-425f-a871-c1f074368964 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.420653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae87d73d-9154-425f-a871-c1f074368964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.431524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:35.432991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:35.439804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ae87d73d-9154-425f-a871-c1f074368964 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:35.440981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ae87d73d-9154-425f-a871-c1f074368964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:35.449044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:35.449992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:35.450951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:35.453032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 403/788] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:35 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:35.464326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:35.551695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 386/789] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:35.580761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3b53d-9983-45c9-a652-9888eeb8d71c None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.581470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3b53d-9983-45c9-a652-9888eeb8d71c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.581964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3b53d-9983-45c9-a652-9888eeb8d71c None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.584372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 387/790] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:35.589452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.589974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.590476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.621058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:35.622844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:35.656352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f9098-9fe0-4b41-8b79-67a2f0c1aaab None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:35.663954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:35.702275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 388/791] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:35.727480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:35.728487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.728984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.729464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.730519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:35.731048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:35.732694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:35.753669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 404/792] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 17 23:14:35 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:35.759682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:35.833187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:35.857196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:35.884078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c8be1-8c2a-473e-97c4-d0c701ce5fbf None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:35.925663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:35.928022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:35.928611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:35.930829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:35.944843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:35.946948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:35.964567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:35.965811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:35.966895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:35.966895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:35.966895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:35.969813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 389/793] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:35.979862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.018049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f469d139-03cf-4519-bd60-4acb4ea1ef56 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.036167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.062217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.063257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.063735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.064192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.080052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:36.085001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:36.085924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:36.086818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 405/794] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:36.087524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.132253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e27bed-37ac-45a1-8768-564e3f80570b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.171967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.176016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.177634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.178068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.178490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.179857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:36.181023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.183046 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.205216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 390/795] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:36.205216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.211896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184a3ea-dd7b-402e-9207-e738e0657f25 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.253761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.255168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.255564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.255947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.267380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:36.272422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:36.273529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:36.274531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:36.281372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 406/796] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:36.281372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.319880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.340233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e966f5-8b2e-40ad-b791-8f68dedff3ea None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.374856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.375475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.375756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.376031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.376697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:36.377005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.378372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.386903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 391/797] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:36.387706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.398878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a2c80-e0e4-4df1-8f9f-edfa27ba90c1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.429579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.436711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.437350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.437632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.437905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.446033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.447203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-30ab9a8d-2af6-4b3a-a008-f2eb4dad16bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:36.458422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:36.459463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:36.460353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 407/798] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:36.461397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37706df-4ea9-4350-ba69-21c7bd22a8f2 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.461397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37706df-4ea9-4350-ba69-21c7bd22a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.461397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37706df-4ea9-4350-ba69-21c7bd22a8f2 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.462576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 408/799] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:36.463118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37706df-4ea9-4350-ba69-21c7bd22a8f2 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.505000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c07a2-6029-41bd-8a64-e7875dd71085 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.541674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.542287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.542572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.542877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.543557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:36.543858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.549213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ea346-ebf8-466e-8f17-f3ca2339fbdd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.559461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 392/800] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:36.560705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.560992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.561268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.574177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.579852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37706df-4ea9-4350-ba69-21c7bd22a8f2 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.581006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:36.582912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:36.618829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.619714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.619999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.620276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.630875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.632328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:36.648072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:36.649050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:36.649963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:36.649963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:36.649963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:36.649963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 409/801] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:36.649963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.661400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 393/802] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:36.662527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.712795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.777795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc5659-37bd-42f7-96f1-1bc340da7544 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.778180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8305c5fd-318f-416b-a967-811e0a1fcc15 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.812361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.812963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.813251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.813523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.814209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:36.814511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.815959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.816666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.817872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.818353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.818949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.821874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.828854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 410/803] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:36.829723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.836832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.838567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-36b45b2f-c730-42d6-94bf-9893714597f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:36.855700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:36.856630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:36.857520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:36.857520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:36.857520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:36.864582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 394/804] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:36.866072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898a9d2-d765-480a-a551-d99c71b9c14a None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.866558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898a9d2-d765-480a-a551-d99c71b9c14a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.867029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6898a9d2-d765-480a-a551-d99c71b9c14a None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.868460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 395/805] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:36.869366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898a9d2-d765-480a-a551-d99c71b9c14a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:36.937405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ff600d-a23f-4310-8987-b88c1b765d3a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.938975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:36.973049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:36.973698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:36.973985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:36.974264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:36.974941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:36.975252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:36.976633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:36.977300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6898a9d2-d765-480a-a551-d99c71b9c14a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:36.987503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 411/806] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:36.988299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.010865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2603627e-8032-4e3f-adcd-18232d8a9ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.011518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603627e-8032-4e3f-adcd-18232d8a9ba5 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.011806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603627e-8032-4e3f-adcd-18232d8a9ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.012084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2603627e-8032-4e3f-adcd-18232d8a9ba5 None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/53bb1987763944d3935ee9479b8032f3/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.013974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603627e-8032-4e3f-adcd-18232d8a9ba5 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=53bb1987763944d3935ee9479b8032f3, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.015439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2603627e-8032-4e3f-adcd-18232d8a9ba5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.027946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 396/807] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:36 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/53bb1987763944d3935ee9479b8032f3/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:37.029199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.029493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.029824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.050014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:37.051880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:37.100789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13b6870-1597-4ebd-a687-df809d501f63 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.104804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.146074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.146626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.146941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.147218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.147879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:37.148185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.149580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.151317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 397/808] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:37.152210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.170744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 412/809] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:37.171267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.210047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.281826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da77203c-3c72-4ede-89ef-d7ad1f34f30d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.293138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b7098-75a0-484e-a690-3d2077765938 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.322094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.323007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.323381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.323818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.324498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.325959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.328451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.329088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.329375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.329656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:37.336015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:37.336999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 17 23:14:37.338145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.340087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.340217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 398/810] 10.222.0.39 () {56 vars in 1129 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:37.340217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.340467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:37.351991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:37.354009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 413/811] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:37.356353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.390163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.443254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.452810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d23cf-2f29-4d90-8592-82c950803934 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.464993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f1ff32-3950-494e-98f9-6473d9bfe1cb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.488171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.488897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.489181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.489492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] PATH_INFO: `/v3/users/nova` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.497867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.499417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.500825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.501552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.501874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.502150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.502809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:37.503113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.504687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.513934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 414/812] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:37.513934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:37.514141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:37.515067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 399/813] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:37.516026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.630799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2460fa-c0fa-4c99-9319-250917100950 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.665341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.665948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.666227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.666502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.667261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:37.667567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.668991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.691626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 415/814] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:37.691626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.693751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.738273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b51daa-5c7e-4a31-b26e-63d591ebb5cf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.740718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.775413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.776299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.776642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.776854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] PATH_INFO: `/v3/services/network` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.777436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.778847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:37.788373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:37.790882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:37.791746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 400/815] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/services/network => generated 88 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:37.792557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.806622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64cca0-f104-44fe-bd1f-dde034f30943 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.846541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.847180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.847466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.847742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.849333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:37.849647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.851125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.868523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 416/816] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:37.869327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.906512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92171993-59b0-4998-8ac4-a99600bc85c7 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.932518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:37.944226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:37.945025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:37.945513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:37.945937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:37.946799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:37.947259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:37.948751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:37.954107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 401/817] 10.222.0.39 () {56 vars in 1124 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:37.955061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:37.980417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829b214a-2daa-4473-8f46-a925446a828a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:37.990371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.015442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.016076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.016364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.016647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.027190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.028683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:38.046749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:38.047744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:38.048624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:38.048624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:38.048624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:38.048624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 417/818] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:38.048624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.076167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb528f-bda4-4835-9b04-037f5cb1a265 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.115007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.115629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.115914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.116193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.116828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] RBAC: Adding query filter params (name=network) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:38.117134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.118742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.123713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 402/819] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:37 2022] GET /identity/v3/services?name=network => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:38.129753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.158834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab53de-d2bf-487a-b756-c3d322ea6c79 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.174184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.195329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.195873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.196161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.196437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.234281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.243523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2537b3-6593-40ac-8abe-d6e1c6945c5f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.262894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.264353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.281901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.282665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.286122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.286122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.286122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.286122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.311756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 403/820] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:14:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:38.312594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.396670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 418/821] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:14:38.398068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.415452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.449344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9b71cb-ddf4-4891-99c0-3957ac822e2b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.493971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.494589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.495059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.495339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.495998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:38.496306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.497707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.514739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 404/822] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:38.514739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.520767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deecddea-a7fc-4143-96cd-64c04a5238a5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.525111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.562093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.562766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.563017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.563297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.563937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] RBAC: Adding query filter params (type=network) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:38.564243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.565784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.575456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 419/823] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:38.575456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.661148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.663422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da33977-e96d-4c12-aba6-4a5856382ed8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.694890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfcf7a7-826a-469e-b987-6b4de4d2d1b1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.713273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.714114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.714400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.714673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.729410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.731137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.734395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.735356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.735844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.736365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.745624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.747419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:38.749607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:38.750557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:38.751518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:38.751518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:38.751518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:38.754781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 405/824] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:38.755969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:38.765498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:38.766419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:38.767358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:38.774363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 420/825] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:38.775639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.835058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.884835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d948ee8b-1194-40a5-bced-e4f6c9d51cb5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.889064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7669f03-b2e5-41ce-a3e3-6f88db6daca4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:38.922321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.922974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.923259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.923535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.924205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.925583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.927359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:38.928221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:38.928718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:38.929192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:38.930043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:38.930687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:38.932433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:38.940977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:38.951590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 406/826] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:14:38 2022] POST /identity/v3/endpoints => generated 337 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:38.951909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 421/827] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:38.957207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:38.957998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:39.112551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1d2f0-66ed-496c-85c8-ef10d95670d9 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.115804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a825-e268-464c-9d89-51e55dc1f902 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.125454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:39.164866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.165812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.166232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.166513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.167269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:39.167577 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:39.169004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc381271-11a8-487a-900c-6ab20df87dff None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:39.169925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.170624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.170885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.171167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.179398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:39.180916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:39.188517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 407/828] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:39.191359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fefcd-ee5b-4fbf-afba-eb1870e05891 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.191359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fefcd-ee5b-4fbf-afba-eb1870e05891 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.191359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fefcd-ee5b-4fbf-afba-eb1870e05891 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.191359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 408/829] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:39.195845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fefcd-ee5b-4fbf-afba-eb1870e05891 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-2c147108-011f-4ea3-9d54-f70c28b8bf0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:39.196769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:39.197614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:39.198502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 422/830] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:39.199622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.199907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.200181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.226574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:39.227834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:39.290854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:39.304177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 423/831] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:39 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:39.305169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:39.318172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fefcd-ee5b-4fbf-afba-eb1870e05891 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.363549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.364479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.365536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.365814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/256d6e0dec3d4855a539044716650173/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.386452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=256d6e0dec3d4855a539044716650173, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:39.388221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:39.410944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 409/832] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:39 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/256d6e0dec3d4855a539044716650173/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:39.435883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39afde8-3fc9-4780-81e0-4d0a823308f5 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.478420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.479094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.479378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.479652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.480366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:39.480674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:39.482134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:39.496646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 424/833] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:39.502903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:39.531145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:39.583469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:39.625655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45815077-7b6e-4ea3-989c-9bba3d7d0b96 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.659069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:39.676700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.678961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.679425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.679907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.680833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8ba4d7dcfc6248118c0100c91a8e0236) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:39.681330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:39.682964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:39.689642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 410/834] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:39 2022] GET /identity/v3/role_assignments?user.id=8ba4d7dcfc6248118c0100c91a8e0236&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:39.711843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dda866d-07ef-421b-b3cc-9fc0f76cb193 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.752518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.753557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.754101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.754623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.767056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:39.773548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:39.774554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:14:39.775442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:39.778468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 425/835] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:39.784823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:39.879771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:39.900620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74bbf17-7fa7-47e1-82f7-b6613f6d77bf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:39.942289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:39.942944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:39.943233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:39.943510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:39.944196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:39.944505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:39.945882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:39.955291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 411/836] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:39.961410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.066184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67f918-d27a-460d-8599-09bbcaaea845 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:40.079883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:40.107254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:40.108252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.108827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.109332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.121191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:40.122990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:40.138260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:40.139298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:40.140185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:40.140185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:40.140185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:40.142229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 426/837] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:40.148873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.253522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6dd873-9501-444f-bf4e-270ee150a4ed None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:40.293229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:40.293229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.293229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.293229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.293545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:40.293545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:40.294388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2422dee0-b2a2-40a2-81ca-d84c459e63b9 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:40.307063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 412/838] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:40.312714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.409068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ad36-989a-4a31-b8d1-98cf7a71a523 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.409258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ad36-989a-4a31-b8d1-98cf7a71a523 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.409536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a226ad36-989a-4a31-b8d1-98cf7a71a523 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.411717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 413/839] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:40.416573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.416857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.417134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.417407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f04ea8-8639-4747-82a8-0357df68c938 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:40.431092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:40.435387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:40.436689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:40.457494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:40.458624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.458951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.459517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.469750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:40.471256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:40.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:40.487661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:40.489019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 427/840] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:14:40 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:40.493482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.518854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 414/841] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:40 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:40.519282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:40.596765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579909f3-ad2a-4086-81f7-d297a85ccd06 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:40.637086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:40.637710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.637998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.638277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.639060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:40.639371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:40.640822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:40.661435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 428/842] 10.222.0.39 () {56 vars in 1135 bytes} [Wed Aug 17 23:14:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:40.668108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.765620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24053bae-cfa7-4d6b-89ba-2f0211048509 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:40.802412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:40.802412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.802946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.802946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.806564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:40.824064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.879768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:40.881254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:40.908056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:40.931498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a6565b-5fcd-47f7-b243-6ff59591db03 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:40.967048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:40.967855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:40.968366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:40.968857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:40.969659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:40.971311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:40.981069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:40.982075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:40.982928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:40.990947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 429/843] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:40 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:40.992424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:40.998538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 415/844] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:40 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:14:41.005082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:41.059074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:41.104413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d42d33-9096-4daa-b509-0083f46573b8 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.124082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e16e2a-0670-4af8-b389-ea4d94e9c897 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.141487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.142423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.142984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.143468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.144304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:41.144898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.146788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.157226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 430/845] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:40 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:41.158396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:41.169199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:41.171297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.171993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.172306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.173056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.186099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.187969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:41.204221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:41.205219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:41.206109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:41.206109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:41.206109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:41.208357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 416/846] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:41.214609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:41.298772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5962666b-603e-40e1-a755-588141238ff1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.322793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:41.337692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2783d-01c5-4da8-be20-ddac1943b154 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.338071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.339574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.340965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.341481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.342334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:41.342880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.344577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.354965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 431/847] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:41.383204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.383850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.384144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.384427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.385105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:41.385419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.386931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b68db73-5f7b-45b2-8489-60dfba9b547e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.401614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 417/848] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:41.407224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:41.484330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:41.517428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075d94-2d86-4b44-8f10-8c5958a1bad7 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.517758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075d94-2d86-4b44-8f10-8c5958a1bad7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.517995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01075d94-2d86-4b44-8f10-8c5958a1bad7 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.518107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7f231f-13fa-4a04-9016-6c1873ac5aae None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.519507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 418/849] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:41.526100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.526392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.526672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.551605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:41.552859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:41.556164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.556817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.557101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.557375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.564460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.566028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:41.583873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:41.585117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:41.586027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 432/850] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:41.591276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:41.652489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 419/851] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:41.705172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38ceb8a-3550-414e-8eb7-14f9e1e55e6a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.737717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:41.744677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.745296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.745627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.745912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.746755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:41.747069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.748510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da4ba00-b7ec-4c2f-889d-873552d16dcb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.762863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 433/852] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:41.768449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:41.782176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96f96-ec0e-4e33-adc9-f489c3211ef0 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.782485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96f96-ec0e-4e33-adc9-f489c3211ef0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.782773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf96f96-ec0e-4e33-adc9-f489c3211ef0 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.784335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 434/853] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:41.789629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.789916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.790195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.809482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:41.810674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:41.859065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:41.886647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b39d0a-0c69-411b-810d-a1447d3d94d8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:41.896774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 435/854] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:41 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:41.928231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:41.929306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:41.929785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:41.930283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:41.931285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=53bb1987763944d3935ee9479b8032f3) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:41.931811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:41.933426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:41.940079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 420/855] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/role_assignments?user.id=53bb1987763944d3935ee9479b8032f3&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:41.981381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.094414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b99f66-7d1e-4a10-ba85-cb9f88df44c6 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.117028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:42.132472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.133108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.133397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.133674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.144017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:42.148722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:42.149621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:42.150504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 436/856] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:14:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:42.156174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.185213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.265723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e320a4-60ec-42fd-a784-cfe91c3b8201 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.317956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.318769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.319154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.319763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.320948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:42.321355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.324377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.327097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c442c0b-5daa-425a-853a-2a19151f6c2d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.339885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 421/857] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:42.342588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.349664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:42.377656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.378315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.378554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.378860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.380643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.382309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:42.398738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:42.399892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:42.401066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 437/858] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:42.401852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.464542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ceadd-311b-48b4-9775-217ffa146fb3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.465190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:42.508367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.509680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.510156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.510614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.527402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.530255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.536476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139cd8f4-c027-4532-86f1-cdc0c21778d9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:42.550378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:42.551584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:42.552473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:42.552473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:42.552473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:42.559687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 422/859] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:42.560936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.585004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.585619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.585905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.586184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.587333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:42.587641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.589636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.601083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 438/860] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:42.602498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.641094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:42.690066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13abe011-5f89-4c6e-bc12-b1173c162e5a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.716233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e092c64-cc87-4f26-95ba-67a115e50c53 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.725887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:42.728536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.729666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.730131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.730583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.731591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:42.732098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.734297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.750578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 423/861] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:42.756068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:42.759550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.760178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.760461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.760739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.762350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:42.762667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.764077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.770396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 439/862] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:42.883336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da6e76-6593-4911-b13d-4f54f236f2ac None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:42.902994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:42.922930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:42.923571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:42.923908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:42.924182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:42.932483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:42.933934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:42.946624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:42.947638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:42.948606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 424/863] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:42.953785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:43.065392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417fa5e-7999-43e1-8b75-29f6118d723c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:43.100549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:43.101632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.102119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.102613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.103637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:43.104170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:43.105871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5422a959-f085-4ed0-8b41-3a14451909f3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:43.126648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 440/864] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 17 23:14:42 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:43.132732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:43.240162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3cc843-3960-474d-8873-4532fe693e47 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:43.281410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:43.282017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.282286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.282560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.333689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:43.357803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:43.359405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:43.366466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be7ffb-853b-466b-b7ee-fd244586ab1a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.367076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be7ffb-853b-466b-b7ee-fd244586ab1a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.367556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71be7ffb-853b-466b-b7ee-fd244586ab1a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.369483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 441/865] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:43.374234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.374510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.374827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.393753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:43.395222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:43.420241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:43.468300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 442/866] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:43.476012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 425/867] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:14:43.479955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:43.581000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9672550-ec1c-4072-a908-fa46d9335c42 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:43.617151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:43.617788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.618071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.618349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.628599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:43.630240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:43.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:43.646516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:43.647458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:43.647458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:43.647458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:43.647458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 443/868] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:43.654031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:43.732412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:43.742114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:43.758247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2dbf1b-81e6-4744-88b7-76332adee0bd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:43.760436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:43.810016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:43.810774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.811103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.811380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.812323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:43.813056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:43.814980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:43.831590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 426/869] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:43.837616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:43.867338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6d5def-7558-49f8-8727-1c7b0d96882a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:43.913279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae589cfe-cd5d-476a-9961-e3a4db60e917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:43.914136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae589cfe-cd5d-476a-9961-e3a4db60e917 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.914420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae589cfe-cd5d-476a-9961-e3a4db60e917 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.915127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae589cfe-cd5d-476a-9961-e3a4db60e917 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.916057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae589cfe-cd5d-476a-9961-e3a4db60e917 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:43.917434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae589cfe-cd5d-476a-9961-e3a4db60e917 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:43.942877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 444/870] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:14:43 2022] POST /identity/v3/services => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:43.957054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dea00-277d-4711-b3da-cfcc549b61ae None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.957373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dea00-277d-4711-b3da-cfcc549b61ae None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.957658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dea00-277d-4711-b3da-cfcc549b61ae None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.963628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 445/871] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:43.965563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:43.965850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:43.966127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:43.967537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c899e1a1-edd7-43f8-a4bd-4fa4b8705d02 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:43.996647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:43.998128 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:44.013134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:44.019991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:44.021038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.021498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.021955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.031257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:44.033166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:44.047159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:44.048321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:44.049403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:44.051879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 427/872] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:44.062810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:44.095967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 446/873] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:43 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:44.178079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a65829-0757-4135-be28-69b54b2a0fed None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:44.213016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:44.213625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.213903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.214173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.214897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:44.215204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:44.216683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:44.230043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 428/874] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:44.236059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:44.239087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:44.349296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df4420-76c2-46a8-8c07-178e79cce468 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:44.374734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:44.385356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:44.385973 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.386259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.386536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.387313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=256d6e0dec3d4855a539044716650173) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:44.387627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:44.389060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:44.398744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 447/875] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:44 2022] GET /identity/v3/role_assignments?user.id=256d6e0dec3d4855a539044716650173&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:44.442313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:44.500729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d12a2d7-1394-4e1c-815d-fe6444936cb4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:44.538860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:44.539509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.539791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.540067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.540666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:44.542039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:44.551910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:44.552978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:44.553844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 429/876] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:44.559083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:44.632890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:44.670592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316e324-5afd-4b0d-9870-db7d0a8859da None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:44.706489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:44.707199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.707703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.707889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.708533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] RBAC: Adding query filter params (name=object-store) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:44.708891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:44.710269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074c46f9-1d70-4fa4-b932-dd4976b7b9ed None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:44.715510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 448/877] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:44.720889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:44.818081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2d5a9-5f42-4c74-abd4-b5f0a4e3fa4c None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.818408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2d5a9-5f42-4c74-abd4-b5f0a4e3fa4c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.818641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf2d5a9-5f42-4c74-abd4-b5f0a4e3fa4c None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.820268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 449/878] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:44.825211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b3319-9411-422b-8fe2-24dd0914c88f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.825502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b3319-9411-422b-8fe2-24dd0914c88f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.825783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b3319-9411-422b-8fe2-24dd0914c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.827354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334330b-b306-4b8c-b4a9-7748519a0833 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:44.845831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:44.846284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c55b3319-9411-422b-8fe2-24dd0914c88f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:44.849424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c55b3319-9411-422b-8fe2-24dd0914c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:44.866680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:44.867321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:44.867629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:44.867875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:44.868513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:44.868813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:44.870288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:44.875908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 430/879] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:44 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:44.933181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 450/880] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:44 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:45.210398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:45.317852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589f9ca-754b-48c2-a059-482dab05bb23 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:45.353336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5475052-717d-400a-a15f-52ffd7ab2a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:45.353950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475052-717d-400a-a15f-52ffd7ab2a3d None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:45.354233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475052-717d-400a-a15f-52ffd7ab2a3d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:45.354515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5475052-717d-400a-a15f-52ffd7ab2a3d None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:45.355206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475052-717d-400a-a15f-52ffd7ab2a3d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:45.356578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5475052-717d-400a-a15f-52ffd7ab2a3d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:45.372530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 431/881] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:14:45 2022] POST /identity/v3/services => generated 269 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:46.020672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602db42-11c1-4769-b5ea-26219711fd66 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.021208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602db42-11c1-4769-b5ea-26219711fd66 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.021208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b602db42-11c1-4769-b5ea-26219711fd66 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.023074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 451/882] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:46.028656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856bb1a-9573-4aab-878e-3bd697861654 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.029064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856bb1a-9573-4aab-878e-3bd697861654 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.029234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856bb1a-9573-4aab-878e-3bd697861654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.047572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5856bb1a-9573-4aab-878e-3bd697861654 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:46.048758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5856bb1a-9573-4aab-878e-3bd697861654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:46.086462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:46.134468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 432/883] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:46.401286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602db42-11c1-4769-b5ea-26219711fd66 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:46.458639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf86a-78f9-4142-b304-f80dcb224494 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.458983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf86a-78f9-4142-b304-f80dcb224494 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.459249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0bf86a-78f9-4142-b304-f80dcb224494 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.460836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 433/884] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:46.465944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.466236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.466518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.467258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:46.486631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:46.492588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:46.522937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b602db42-11c1-4769-b5ea-26219711fd66 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:46.564666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:46.565230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.565516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.565904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.566666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:46.568133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:46.570953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 434/885] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:46.577447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:46.578398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:46.579264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 452/886] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:46.585255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:46.681218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:46.688003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cdfe6e-ba42-4e2a-a54b-f456cfd117b8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:46.724362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:46.724969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.725302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.725583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.726216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:46.726520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:46.727944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c21dbb-9f5a-4b43-ba77-38bc09762d34 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:46.737332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 435/887] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:46.739861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:46.841857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076beb55-7bc1-409f-b360-34c2674d1647 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:46.846547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716b2b-1b24-475a-a31f-df3cd457eaf7 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.847088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716b2b-1b24-475a-a31f-df3cd457eaf7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.847690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00716b2b-1b24-475a-a31f-df3cd457eaf7 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.849497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 436/888] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:46.854569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.855100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.855600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.868558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:46.876870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:46.878162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:46.880669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:46.881277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:46.881713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:46.881947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:46.882589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:46.882921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:46.884292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:46.896075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 453/889] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:46 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:46.897399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:46.954937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 437/890] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:46 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:46.955796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.005208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01029d3-2849-4a0d-be74-78f39ee6db44 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.041176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.042689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.043215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.043702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.056807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:47.062061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:47.063063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:47.063911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 454/891] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 17 23:14:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:47.069510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.077918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:47.092343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c956ae-7a8d-4b0f-9263-aeba3e5fc737 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.125846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:47.143473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.144090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.144532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.144864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.145600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] RBAC: Adding query filter params (interface=public, service_id=1468ca930dc640bea4d7664073568bf7, region_id=RegionOne) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:47.146166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.148260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.159387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 438/892] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:14:46 2022] GET /identity/v3/endpoints?service_id=1468ca930dc640bea4d7664073568bf7&interface=public®ion_id=RegionOne => generated 194 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:47.171193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.186966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a591e35-a2e4-4df0-a567-2883e941ce6f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.223927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.224790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.225215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.225632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.226603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:47.227078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.228573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.237913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 455/893] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:47.245975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.277581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a27b76-a008-4df3-b829-73f2ec56852a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.314817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.315438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.315724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.316320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.316900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.318272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.325036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 439/894] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:14:47.325661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.349569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:47.385799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e139f33-497f-41be-b124-98bad2b38580 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.402265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:47.431101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.431804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.432440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.432440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.444469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.445200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a5f805-4579-4386-a217-dd0996828f00 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.445972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-54e25405-aaf6-4349-9155-b03083d79921 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:47.461686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:47.462739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:47.463656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:47.463656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:47.463656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:47.463656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 456/895] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:47.469128 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044306-69cd-4976-bcc6-0affd38dc2a6 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.469422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044306-69cd-4976-bcc6-0affd38dc2a6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.469705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3044306-69cd-4976-bcc6-0affd38dc2a6 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.471135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 457/896] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:47.472573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044306-69cd-4976-bcc6-0affd38dc2a6 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.493258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1ee241-70e1-4984-b969-a18844fc2972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.493878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ee241-70e1-4984-b969-a18844fc2972 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.494164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ee241-70e1-4984-b969-a18844fc2972 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.494439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1ee241-70e1-4984-b969-a18844fc2972 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.495126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ee241-70e1-4984-b969-a18844fc2972 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.496509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce1ee241-70e1-4984-b969-a18844fc2972 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.516910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 440/897] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:14:47 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:47.516910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.516910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.516910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.534569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:47.536150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:47.610721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3044306-69cd-4976-bcc6-0affd38dc2a6 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.626797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 441/898] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:47 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:47.649071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.649698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.649983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.650258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.651274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:47.651577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.653051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.667638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 458/899] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:47.673359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.685459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:47.792946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c326dd-b3e2-4b96-8b23-636b8fb65158 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.829358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:47.829988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:47.830269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:47.830542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:47.838145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:47.839599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:47.852578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:47.853557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:47.854834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 442/900] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:47.859443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.879453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:47.895252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:47.970059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28d8bd-fcea-4f8a-9165-127d80a98a21 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:47.982177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.010944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.011657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.012030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.012381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.013183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:48.013557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.015221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.028270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e4cffd-7aa9-4c44-8770-d096ba656fd8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.042728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 459/901] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:48.046558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.077674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.078898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.079933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.080761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.081769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.084314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:48.099218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:48.100210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:48.101107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:48.104511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 443/902] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 17 23:14:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:48.109408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.153962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.179736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b255a31-54a9-4fef-b937-bd63b47d80db None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.216324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.217286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.217467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9023bc3-35de-42ed-8629-f1520cbd9aeb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.217967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.218440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.248669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.254858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.255648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.256030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.256316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.257578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:48.257578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.258619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.268549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 444/903] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:48.269988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.304857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.306609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.380553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0871efd1-52ae-4e79-bc0e-b7d7e064adfc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.387714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.416288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 460/904] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:14:48.420935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.421552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.421835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.422110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.422790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:48.423102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.424140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.424471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.435894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 445/905] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:48.436877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.505973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.535850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a596be-9206-4e37-a669-a3a80b8b9c14 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.553930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3301f0a8-19c6-4924-bdf5-244ab94c0d1a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.572145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.572780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.573085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.573346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.583648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.585103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.595118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.595971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.596429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.596870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.598581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] RBAC: Adding query filter params (interface=public, service_id=4b21047f0fbc453da60d4dd13926c8ee, region_id=RegionOne) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:48.599373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:48.600752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:48.601699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:48.602580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:48.602580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:48.602580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:48.603689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.606827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 461/906] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:48.607836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.615397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 446/907] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/endpoints?service_id=4b21047f0fbc453da60d4dd13926c8ee&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:48.616563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.639209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.715683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47518453-a0b6-4299-b7c0-83c35a54d3a8 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.732115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b58c6c-e98c-44ff-a5c5-7a0c2062d6d8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.751290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.751924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.752210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.752485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.753247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:48.753459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.755299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.762751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.773469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 462/908] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:48.775406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:48.776486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.777366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.777849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.778444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.779435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.781209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.794734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 447/909] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:14:48.876108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:48.887795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f7cc03-774d-45b4-b591-971da146591f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:48.926243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:48.927046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:48.927333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:48.927610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:48.936496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:48.936808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:48.949107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:48.950019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:48.950947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:48.953517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 463/910] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:48.956274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:49.064800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d2fac2-fceb-4611-8a9c-4df16f2b4d0f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:49.100198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:49.100940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.101177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.101406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.102160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:49.102473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:49.103942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa8d8d8-cdf5-4b6c-9c43-33e1b01ef943 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:49.116658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 448/911] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:49.123783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:49.230473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3074f-a099-4135-81c9-377d23934d74 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:49.265859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:49.266891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.267379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.267873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.268808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] RBAC: Adding query filter params (role.id=8691b7c789e44d9ea32342db0aa18e15, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=256d6e0dec3d4855a539044716650173) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:49.269462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:49.271202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bf05d0-3fc7-4f60-9801-af264395445d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:49.290910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 464/912] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:49 2022] GET /identity/v3/role_assignments?user.id=256d6e0dec3d4855a539044716650173&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=8691b7c789e44d9ea32342db0aa18e15 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:49.320840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520e5b-ba68-48a7-aa58-3b6e0447beed None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.321041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520e5b-ba68-48a7-aa58-3b6e0447beed None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.321387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14520e5b-ba68-48a7-aa58-3b6e0447beed None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.323064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 449/913] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:49.328749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d42ca-24f5-46d8-9d58-d7cb7fc54916 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.329054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d42ca-24f5-46d8-9d58-d7cb7fc54916 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.329324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d42ca-24f5-46d8-9d58-d7cb7fc54916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.361308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ec7d42ca-24f5-46d8-9d58-d7cb7fc54916 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:49.362557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ec7d42ca-24f5-46d8-9d58-d7cb7fc54916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:49.372436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:49.440230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 465/914] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:49.591539 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d4dc1-7c5b-4a67-bb03-f560ba6aa9f9 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.591734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d4dc1-7c5b-4a67-bb03-f560ba6aa9f9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.591993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944d4dc1-7c5b-4a67-bb03-f560ba6aa9f9 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.593607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 450/915] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:49.599351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.599641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.599915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.618548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:49.619766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:49.696106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 466/916] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:49 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:49.741587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d4dc1-7c5b-4a67-bb03-f560ba6aa9f9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:49.796099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:49.850974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944d4dc1-7c5b-4a67-bb03-f560ba6aa9f9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:49.886832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:49.887473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:49.887762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:49.888082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:49.888679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:49.890053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:49.900137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:49.901403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:49.902395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 451/917] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:49.910515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:49.972489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:49.996615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:50.032271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687804fc-cb0c-45ab-9ec7-1141c7356c4c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.070055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.070672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.070999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.071279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.072391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:50.072391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.073586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.079090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 467/918] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:50.085733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:50.112178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbae5c-a6cb-4006-878c-3a406526b72d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.130605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:50.157835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.158484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.158802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.159077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] PATH_INFO: `/v3/services/object-store` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.159662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.162165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:50.172915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:50.173906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:50.174764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:50.179061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 452/919] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:50.180833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:50.234511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6eec57-36f6-4430-a8ac-90c79d459dd5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.278376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.279019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.279475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.279773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.280386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:50.280684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.282102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.284729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:50.288721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 468/920] 10.222.0.39 () {56 vars in 1114 bytes} [Wed Aug 17 23:14:50 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:50.295740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:50.305195 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295c4424-68de-42fd-8f87-7af5ed21fadb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.348504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.349040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.349327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.349605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.350251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:50.350568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.351977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.357339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 453/921] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:50.364609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:50.411179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:50.431799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6907d-900d-4f4a-9582-51b0bbcb850b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.469818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.470847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.471329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.471799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.472798 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.474470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.493783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b5b6ee-04c3-4201-9d1f-3dbeee0dc9f5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.500635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 469/922] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:14:50 2022] POST /identity/v3/endpoints => generated 346 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:50.544849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.545472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.545808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.546094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.546846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:50.547160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.548546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.555740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 454/923] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:50.561977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:50.634533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:50.688169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd7be-855b-44fc-9b56-7fa9044190ed None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.727965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.729047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.729547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.730020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.730997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] RBAC: Adding query filter params (interface=public, service_id=a57d9dcd51414ef9a956ed7bcbc02e27, region_id=RegionOne) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:50.731515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.733168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e504544c-2879-4eed-ac52-0608beb7ae79 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.740088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 470/924] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:14:50 2022] GET /identity/v3/endpoints?service_id=a57d9dcd51414ef9a956ed7bcbc02e27&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:50.745650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:50.856247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:50.860475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efae64ac-c308-4960-a489-bcb49a7cbdbc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:50.896053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c109-f5f7-4748-bd40-80fe9e0bc3d5 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.896680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c109-f5f7-4748-bd40-80fe9e0bc3d5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.897119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e8c109-f5f7-4748-bd40-80fe9e0bc3d5 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.898842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 471/925] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:50.906130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:50.907204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.907628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.908032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.908770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:50.910597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:50.911420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6db7-56cd-426a-ad7f-3fbc7f88dd18 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:50.911801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6db7-56cd-426a-ad7f-3fbc7f88dd18 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:50.912323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17e6db7-56cd-426a-ad7f-3fbc7f88dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:50.917615 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 455/926] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:14:50 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:14:50.932274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c17e6db7-56cd-426a-ad7f-3fbc7f88dd18 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:50.933699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c17e6db7-56cd-426a-ad7f-3fbc7f88dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:51.009636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 472/927] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:51.292254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:51.337631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f30c-47b3-4515-9873-04445984fac7 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.338177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f30c-47b3-4515-9873-04445984fac7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.338177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8336f30c-47b3-4515-9873-04445984fac7 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.339799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 473/928] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:51.344699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.344981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.345252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.365170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:51.366363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:51.415758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43648c5f-d41b-4299-bd89-f8e77edb13c4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:51.421800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:51.454736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 474/929] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:51 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:51.468442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:51.469381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.469849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.470348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.471191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:51.473567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:51.482746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:51.483775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 17 23:14:51.484732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:51.487054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 456/930] 10.222.0.39 () {56 vars in 1132 bytes} [Wed Aug 17 23:14:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:51.493989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:51.601396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f57adf-0aa5-4011-b4fe-4553ab4a40c0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:51.641879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:51.642501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.642826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.643114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.643758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:51.644217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:51.645825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:51.651211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 475/931] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:51.656683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:51.692433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:51.766892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b866ef-0a97-4631-bea6-ff54636b6336 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:51.773459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:51.810273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:51.811082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.811372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.811775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.813175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:51.813496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:51.814899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:51.822752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 457/932] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:51.826831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:51.829703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:51.891732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc3ceb0-7226-43bd-80f6-97074b94360f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:51.923095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:51.929890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:51.930866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.931420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.931937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.933806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05055357-b14d-4421-ab78-63b552d6fab2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:51.943899 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:51.948989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:51.949937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:14:51.950839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:51.953560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 476/933] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 17 23:14:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:51.959974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:51.981031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:51.982055 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:51.982567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:51.983707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:51.984887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:51.987215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:52.016259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 458/934] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:14:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:52.088439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57490fd1-f855-4ac6-9008-0187614c1506 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:52.091321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:52.135152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:52.135771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.136052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.136327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.136999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:52.137303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:52.138694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:52.149259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 477/935] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:14:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:52.155106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:52.265020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b058a04b-17b0-4f56-b945-9e23e45f9684 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:52.304100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:52.304768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.305009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.305278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.317459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:52.318957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:52.327236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:52.335802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:52.336932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:52.337839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:52.337839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:52.337839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:52.337839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 459/936] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:52.343316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:52.449859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66d45de-b11d-4723-b2df-6a9d437f9c01 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:52.485149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:52.485759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.486041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.486316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.486995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:52.487296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:52.489746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169208e8-2980-4f90-a8ec-206391219b4e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:52.502383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 478/937] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:52.508381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:52.617583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b875f5f-5137-477e-9d89-acae9e4b0f2a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:52.648626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673c41-dedc-40cb-ba62-c30d52161322 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.649374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673c41-dedc-40cb-ba62-c30d52161322 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.649973 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94673c41-dedc-40cb-ba62-c30d52161322 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.652537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 479/938] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:52.654799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:52.654799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.654799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.654799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.657804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.657932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.658321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.664377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:52.666038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:52.677516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:52.678072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:52.679248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:52.680212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 460/939] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:14:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:52.682187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:52.687691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:52.701318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:52.766737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 480/940] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:52.773338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:52.817108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e535bf-34ad-4aea-8976-54f4abfcf85b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:52.851830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:52.852438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.852719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.853048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.853774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:52.854078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:52.855519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249b54f3-bc09-47a4-aa44-0f50da6c0888 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:52.873478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 461/941] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 17 23:14:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:52.879718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:52.934966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43d441-91bc-4301-9f67-c530e31a8ae8 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.935301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43d441-91bc-4301-9f67-c530e31a8ae8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.935520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f43d441-91bc-4301-9f67-c530e31a8ae8 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.937104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 462/942] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:14:52.946050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:52.946334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:52.946610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:52.964792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:52.965971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:52.990780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c92bf21-b4ec-454c-9550-7415f310ef72 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.029923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.030650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.031072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.031356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.039405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 463/943] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:53.042929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.043917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.044399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:53.060386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:53.061377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:53.062265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:53.062265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:53.062265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:53.062265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 481/944] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:53.068878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.073981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.108499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.175897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9351bf3-06f0-4d8b-ab4c-b0b4a6be5f19 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.193085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e80be9-a4c7-4954-ba57-57991af1547a None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.221410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.223056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.223579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.224248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.225465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.227394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.229824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.230346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING keystone.server.flask.common [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 17 23:14:53.230659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.231063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.231436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.232184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:53.232585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.234099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.247430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 482/945] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:53.251638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.sql.core [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 23:14:53.251638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 23:14:53.251638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [parameters: {'id': '235852baa8d441eeac634d6233439e5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 23:14:53.251638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85576) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 23:14:53.252601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 235852baa8d441eeac634d6233439e5b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 235852baa8d441eeac634d6233439e5b. Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application conn.query(q) Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 23:14:53.274172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result.read() Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 17 23:14:53.275119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application next(self.gen) Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application yield resource Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application next(self.gen) Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise self.value Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application session.commit() Aug 17 23:14:53.276369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.session.flush() Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application compat.raise_( Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 23:14:53.277272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 23:14:53.278221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application conn.query(q) Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result.read() Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 23:14:53.280907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [parameters: {'id': '235852baa8d441eeac634d6233439e5b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.283807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:53.286351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 235852baa8d441eeac634d6233439e5b. Aug 17 23:14:53.289526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.298777 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 464/946] 10.222.0.39 () {60 vars in 1140 bytes} [Wed Aug 17 23:14:53 2022] POST /identity/v3/projects => generated 262 bytes in 255 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:53.301671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.332314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.374994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2b21c-bcd8-4666-9098-4596d1a6650c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.410757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.411399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.411683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.411957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.416872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed538c84-432e-4b62-9b2a-4a712bbaa9d0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.418484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.419529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.419968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:53.431465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:53.432391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:53.433285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 483/947] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:53.433788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.467819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.468456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.468764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.469045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.477944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.480242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:53.494332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:53.495304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 465/948] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:53.496207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.544530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d517a-6fc4-4380-8a67-c7b5463e7e26 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.568749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.580738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.581375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.582310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.582594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.583225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.584605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:53.593343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:53.594375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:53.595248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 484/949] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:53.596540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.616083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1876b-d95b-43e3-8b6c-108fd5de08ea None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.650387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.651680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.652258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.652737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.653648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:53.654173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.655844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.672015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 466/950] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:53.673206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.701932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.709560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb4094f-9322-40cc-ab6a-36772e07d972 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.746038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.746577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.746896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.747172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.747844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:53.748154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.749595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.778740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 485/951] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:53.778740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.798915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d4381-fe0c-4501-a064-51cd0502b1c8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.831444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:53.843418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.844430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.844814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.845192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.846031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:53.846559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.848052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.854566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 467/952] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:53.863826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:53.892615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0578b2b9-9bf7-4aab-88a4-c9fb751ecf2c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:53.946634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:53.947343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:53.947627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:53.947909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/256d6e0dec3d4855a539044716650173/roles/8691b7c789e44d9ea32342db0aa18e15` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:53.951067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=256d6e0dec3d4855a539044716650173, role_id=8691b7c789e44d9ea32342db0aa18e15)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:53.952801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:53.970001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 486/953] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:14:53 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/256d6e0dec3d4855a539044716650173/roles/8691b7c789e44d9ea32342db0aa18e15 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:14:53.980662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:54.001078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b4d4ff-51a3-4544-ae6e-79b0c66f9fd4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:54.045755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:54.046412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:54.046741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:54.046998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:54.047659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:54.047990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:54.049377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219fc36a-910a-4507-b34b-06fd145814bc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:54.055534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 468/954] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:54.061007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:54.134766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9123c5-705a-46f7-9188-e35dc7c15e47 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:54.135100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9123c5-705a-46f7-9188-e35dc7c15e47 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:54.135326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9123c5-705a-46f7-9188-e35dc7c15e47 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:54.136668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 469/955] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:54.142130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:54.142567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:54.142928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:54.166030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:54.167293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:54.187311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd47e3-7408-475b-866a-8db359097ffe None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:54.199481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:54.236037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:54.236654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:54.236936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:54.237207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:54.238418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:54.239921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:54.256637 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 470/956] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:54.266114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 487/957] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:14:54 2022] POST /identity/v3/endpoints => generated 349 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:54.530157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:54.618879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:54.637988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84c6a1-e008-4b80-a5a2-7dd5fe30560d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:54.679974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:54.680611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:54.680895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:54.681169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] PATH_INFO: `/v3/services/compute` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:54.681759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:54.683162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:54.692387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:54.693470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:54.694459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 471/958] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:54.701726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:54.807731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7097691-16d1-49d2-a3e3-162f28eb856b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:54.843144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:54.843758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:54.844041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:54.844316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:54.844999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] RBAC: Adding query filter params (name=compute) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:54.845307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:54.846677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a7d78-63f9-4b66-9273-b4de460c8660 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:54.852158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 488/959] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:54.859817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:54.968634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59006ba4-13b9-47f3-b89b-96ba9555e821 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:55.004176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:55.004794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:55.005078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:55.005354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:55.005997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] RBAC: Adding query filter params (type=compute) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:55.006306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:55.007713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25af19c-801b-48a5-8589-60e5e1adc3bb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:55.012798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 472/960] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:14:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:55.944984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043bd58-a905-42d7-a372-bd28d5ca4787 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:55.945520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043bd58-a905-42d7-a372-bd28d5ca4787 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:55.945520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e043bd58-a905-42d7-a372-bd28d5ca4787 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:55.947154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 489/961] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:55.952310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:55.952736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:55.952973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:55.966714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:55.972527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:55.974105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:56.000010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e38eb-5333-4a36-9b5b-4106b06f4289 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.000353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e38eb-5333-4a36-9b5b-4106b06f4289 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.000564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e38eb-5333-4a36-9b5b-4106b06f4289 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.002155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 490/962] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:56.008059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7632-5df8-4e05-8d65-14d3487b0554 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.008348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7632-5df8-4e05-8d65-14d3487b0554 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.008798 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ae7632-5df8-4e05-8d65-14d3487b0554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.029045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e7ae7632-5df8-4e05-8d65-14d3487b0554 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:56.030233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e7ae7632-5df8-4e05-8d65-14d3487b0554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:56.049135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 473/963] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:56.060534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:56.114979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 491/964] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:14:56.324029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.329846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6a269-8092-4806-bd6b-71a20b94426a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.330138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6a269-8092-4806-bd6b-71a20b94426a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.330412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d6a269-8092-4806-bd6b-71a20b94426a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.332891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 492/965] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:56.342411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.342411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.342411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.360942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:56.363375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:56.437640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777e3414-645c-4f4d-8567-8395a3634877 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:56.446588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 493/966] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:56.447479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.480319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:56.481282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.481761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.482219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.483084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:56.484719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:56.496550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:56.505681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.sql.core [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 23:14:56.505681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 23:14:56.505681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [parameters: {'user_id': 'edfe496d811c42b6b824546ab1895165', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 23:14:56.505681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=85576) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application conn.query(q) Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result.read() Aug 17 23:14:56.515085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 23:14:56.516012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application next(self.gen) Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application yield resource Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application next(self.gen) Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.session.rollback() Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.force_reraise() Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise self.value Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application session.commit() Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 17 23:14:56.516980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._prepare_impl() Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.session.flush() Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._flush(objects) Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application compat.raise_( Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application flush_context.execute() Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rec.execute(self) Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 17 23:14:56.517880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 17 23:14:56.518814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result = self._query(query) Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application conn.query(q) Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application result.read() Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 17 23:14:56.520157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [parameters: {'user_id': 'edfe496d811c42b6b824546ab1895165', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:56.521033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 17 23:14:56.521860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 17 23:14:56.522816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 17 23:14:56.522816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 17 23:14:56.522816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 17 23:14:56.522816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 17 23:14:56.522816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 17 23:14:56.522816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:56.525144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 474/967] 10.222.0.39 () {60 vars in 1131 bytes} [Wed Aug 17 23:14:56 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:56.531321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.555416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:56.569233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a1b01-4ad9-4b57-a648-426313b365ee None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:56.607055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:56.607781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.608132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.608471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.620088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:14:56.625169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:56.626396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:14:56.627471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:56.634137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 494/968] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 17 23:14:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:56.635301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.653198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8cea-03ad-4934-8a2e-bae399bb631b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:56.689830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:56.691372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.691805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.692249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.700794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:56.702672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:56.714986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:56.716165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 17 23:14:56.717324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:56.719572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 475/969] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:14:56 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:56.730896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.751525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b6aac-e070-4ec8-9083-159bc1ca2a2d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:56.789636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:56.790247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.790532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.790854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.791554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:56.791862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:56.793244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:56.793481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:56.802474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 495/970] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:14:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:56.803498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.820595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:56.842143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99686b78-baf1-481b-9578-9e1dfdd47874 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:56.879999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:56.880625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.880910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.881186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.881891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:56.882202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:56.883713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:56.919115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88b0a69-6c72-4279-adb7-1836fc2de71c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:56.938844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 476/971] 10.222.0.39 () {56 vars in 1101 bytes} [Wed Aug 17 23:14:56 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:56.938844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:56.976005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:56.976725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:56.977546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:56.977831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] PATH_INFO: `/v3/services/object-store` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:56.978443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:56.980303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-32916118-b88f-420a-adc6-9e1bd03d53bf None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:56.993357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:56.994453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:14:56.995359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:56.998894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 496/972] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:14:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:57.000860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017411d-a51e-4ce1-8d5e-3866a4130d25 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.001151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017411d-a51e-4ce1-8d5e-3866a4130d25 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.001428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2017411d-a51e-4ce1-8d5e-3866a4130d25 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.002967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 497/973] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:57.008117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017411d-a51e-4ce1-8d5e-3866a4130d25 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.048734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8519ff74-f7e8-4d74-a3cd-f087f46f4838 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.073453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.098678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.099817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.099817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.100009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.106424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.114295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.115793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-3db579ec-cb9f-4e8d-b25d-820a974f6f65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:57.131825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:57.132815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:57.133711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:57.133711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:57.133711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:14:57.133711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 477/974] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:57.138726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.138726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.138726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.142949 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2017411d-a51e-4ce1-8d5e-3866a4130d25 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.157540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:57.159371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:57.183024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.184236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.184236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.184236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.184790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:57.185092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.186456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.192828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 498/975] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:57.193393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.236475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 478/976] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:57.237793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.299922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc40ff4-f675-4fce-9646-3a41dde34c87 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.335542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.336167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.336462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.336748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.337396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:57.337705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.339115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.346503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.351356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.358950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 499/977] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:57.360293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.361543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47556fb3-a779-4f3c-845a-41468db791dd None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.402177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.402821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.403110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.403389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.404032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:57.404522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.405698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.411785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 479/978] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:57.417339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.468706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d73179-d377-4323-a2d2-6f770caa2008 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.505290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.505932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.506220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.506504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.513615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.515092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.522490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24617f9b-a5b2-47e3-b58f-41ae98fc5946 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:14:57.527256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:57.533179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 500/979] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:57.534406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.564386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.564992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.565277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.565545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.566417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] RBAC: Adding query filter params (interface=admin, service_id=a57d9dcd51414ef9a956ed7bcbc02e27, region_id=RegionOne) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:57.566749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.568114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.573093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 480/980] 10.222.0.39 () {56 vars in 1249 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/endpoints?service_id=a57d9dcd51414ef9a956ed7bcbc02e27&interface=admin®ion_id=RegionOne => generated 193 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:57.573912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.587624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.604462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.631537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bed1b95-a440-498e-8209-ff641e827e38 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.664414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.665027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.665311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.665588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.666227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.667628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.678427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2ae3b2-4348-4bdc-81a2-7f7dd2c7a394 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.683069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 501/981] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:14:57 2022] POST /identity/v3/services => generated 242 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:14:57.683876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.731574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.732244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.732619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.732899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.733666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:57.733980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.735556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.758639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 481/982] 10.222.0.39 () {56 vars in 1149 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:57.764610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:57.803914 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd9fa27-8ad9-4073-a3fd-aae64928eeaf None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.823000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.849235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.849785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.850073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.850349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:57.851145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:57.852529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:57.857711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:57.861143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 502/983] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/services => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:14:57.889001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e2f1be-693b-41cf-819c-56cbc7e63994 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:57.929476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:57.930112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:57.930398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:57.930675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:58.014783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:58.016234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:58.102813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:58.122735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 482/984] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:14:57 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:14:58.129097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:58.234954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250ebbd3-4a96-444e-bac3-b41e634cd7d7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:58.270078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:58.270716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:58.271006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:58.271279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:58.286068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:58.286068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:14:58.300193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:58.301320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:14:58.302212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:14:58.302212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:14:58.302212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:58.302212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 503/985] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:14:58.308061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:58.414154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123a4d88-517c-48db-ba41-5675933177c0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:58.448797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:58.449752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:58.450236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:58.450734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:58.451575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:58.452096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:58.453649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:58.464867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 483/986] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:58.470434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:58.508027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:58.574914 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f228eab8-36c1-4b8f-b091-c190e85296d9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:58.608469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:58.609094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:58.609380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:58.609654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:58.616745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:58.618184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:14:58.629160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:14:58.630030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:14:58.630978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 504/987] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:14:58.635989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:58.681469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:58.742650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82937f1a-203f-4ca1-8116-48e5ba98708c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:58.776156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:58.776757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:58.777035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:58.777307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:58.778023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:58.778327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:58.779773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a08cda-b83d-40bf-95cd-84f1e8551d06 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:58.797927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 484/988] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:14:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:14:58.799487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:14:58.893021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:14:58.901892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48632299-19f9-4b5b-8e55-bd8a70a9d687 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:14:58.935098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:14:58.935634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:58.935917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:58.936193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:58.936918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] RBAC: Adding query filter params (role.id=8691b7c789e44d9ea32342db0aa18e15, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=256d6e0dec3d4855a539044716650173) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:14:58.937226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:14:58.938651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c4e651-1026-457a-9729-dfaf1f402d0d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:14:58.950740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 505/989] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:14:58 2022] GET /identity/v3/role_assignments?user.id=256d6e0dec3d4855a539044716650173&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=8691b7c789e44d9ea32342db0aa18e15 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:14:59.632281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b972f7-f70f-4698-9ac2-2f01d6e05214 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:59.632796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b972f7-f70f-4698-9ac2-2f01d6e05214 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:59.632796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b972f7-f70f-4698-9ac2-2f01d6e05214 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:59.634232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 485/990] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:59.639144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a05b6-e316-405d-9a88-0e585850d703 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:59.639516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a05b6-e316-405d-9a88-0e585850d703 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:59.639696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19a05b6-e316-405d-9a88-0e585850d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:59.658158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a19a05b6-e316-405d-9a88-0e585850d703 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:59.659898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a19a05b6-e316-405d-9a88-0e585850d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:59.724967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 506/991] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:59.807001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bbd1-66e0-476c-aeea-1206a861479e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:59.807332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bbd1-66e0-476c-aeea-1206a861479e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:59.807570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8660bbd1-66e0-476c-aeea-1206a861479e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:59.809050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 486/992] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:14:59.814145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:14:59.814438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:14:59.814730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:14:59.833613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:14:59.834826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:14:59.899592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 507/993] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:14:59 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:14:59.995984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660bbd1-66e0-476c-aeea-1206a861479e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.097330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:00.101694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8660bbd1-66e0-476c-aeea-1206a861479e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.136576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.137214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.137499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.137773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] PATH_INFO: `/v3/services/compute` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.138359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.139761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:00.149284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:00.151047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:15:00.152681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:00.154639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 487/994] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:14:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:00.156516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.174105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.177173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:00.261574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c5063-ce60-462e-bb52-d86c0e91b26f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.290371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56a03d0-7b40-4296-8bc5-592935d02d9a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.300507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.301403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.301687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.301970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.302618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] RBAC: Adding query filter params (name=compute) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:00.302966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.304348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.309793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 508/995] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:00.315380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.328488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.329121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.329405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.329678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.330366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.332207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:00.341013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:00.342020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:00.342896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 488/996] 10.222.0.39 () {56 vars in 1126 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:00.348153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.379265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:00.408216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:00.428789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6be3c7-f47e-4a13-b1f7-ff493eaea18c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.457603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f22eb55-f031-4d81-adf2-f231d503829d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.466114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.466751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.467048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.467327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.467963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] RBAC: Adding query filter params (type=compute) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:00.468274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.469643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.475809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 509/997] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:00.481521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.499836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.500449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.500737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.501020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.501658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:00.501971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.503398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.508562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 489/998] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:00.514120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.586254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a53afd-4796-43b2-a753-1a496bdfb1bd None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.608958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:00.621224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b4b93-1a90-4651-8c48-b1dd15e8a102 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.624510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.625129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.625416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.625719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.626427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] RBAC: Adding query filter params (interface=public, service_id=a11419c5d4cd4d5ba4c0702f75ccdac4, region_id=RegionOne) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:00.626771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.628696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.639327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 510/999] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/endpoints?service_id=a11419c5d4cd4d5ba4c0702f75ccdac4&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:00.640321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.653912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:00.664076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.664645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.664909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.665189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.665826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:00.666135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.667538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.672726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 490/1000] 10.222.0.39 () {56 vars in 1122 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:00.678320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:00.747906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a8f354-7563-455b-8c89-a4078db52f59 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.782142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbb79bc-0ba9-4919-80d5-a8a4d2be754b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:00.783328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca474568-8993-47c8-a82a-f994b2739b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.783942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca474568-8993-47c8-a82a-f994b2739b5b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.784225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca474568-8993-47c8-a82a-f994b2739b5b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.784559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca474568-8993-47c8-a82a-f994b2739b5b None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.785165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca474568-8993-47c8-a82a-f994b2739b5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.786540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca474568-8993-47c8-a82a-f994b2739b5b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.794153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 511/1001] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:15:00 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:15:00.820573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc5c89e-4daa-47d1-9185-a5d21fd58ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:00.821306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5c89e-4daa-47d1-9185-a5d21fd58ef7 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.821656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5c89e-4daa-47d1-9185-a5d21fd58ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.821997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc5c89e-4daa-47d1-9185-a5d21fd58ef7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.822783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5c89e-4daa-47d1-9185-a5d21fd58ef7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:00.824261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc5c89e-4daa-47d1-9185-a5d21fd58ef7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:00.850736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 491/1002] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:15:00 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:15:00.920359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d4919-f017-464c-8d5a-c562190be118 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.920563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d4919-f017-464c-8d5a-c562190be118 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.920821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d4919-f017-464c-8d5a-c562190be118 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.922407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 512/1003] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:00.929263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:00.929650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:00.930003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:00.949710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:00.951076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:00.964754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:01.036938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 492/1004] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:00 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:01.305218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d4919-f017-464c-8d5a-c562190be118 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:01.383953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:01.410857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d4919-f017-464c-8d5a-c562190be118 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:01.444920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:01.445555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:01.445839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:01.446116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] PATH_INFO: `/v3/services/image` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:01.446697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:01.448090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:01.456721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:01.457690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:01.458540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:01.462841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 513/1005] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 17 23:15:01 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:01.464057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:01.565937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b69091c-f74d-4b25-a15c-3a92d2800cd3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:01.600733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:01.601341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:01.601618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:01.601887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:01.602520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] RBAC: Adding query filter params (name=image) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:01.602851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:01.604205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb29d8be-15ab-41d6-a14f-f3685a2d4218 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:01.614377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 493/1006] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:01.615394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:01.714535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eada7cc-4807-4448-980e-21b2ac2261c3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:01.749459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:01.750070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:01.750349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:01.750619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:01.751284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] RBAC: Adding query filter params (type=image) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:01.751587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:01.753180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c761ce-2fe1-4141-8ccc-f58ed3e1ef3f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:01.766974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 514/1007] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:02.730488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45b719-3d4b-4744-9b71-91a22027745e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:02.731018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45b719-3d4b-4744-9b71-91a22027745e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:02.731018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45b719-3d4b-4744-9b71-91a22027745e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:02.732511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 494/1008] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:02.737782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:02.738171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:02.738319 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:02.744596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:02.757650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:02.758876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:02.801158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c98f3f-3e7d-4282-be60-7e47de8e7169 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:02.801443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c98f3f-3e7d-4282-be60-7e47de8e7169 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:02.801723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c98f3f-3e7d-4282-be60-7e47de8e7169 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:02.803109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 495/1009] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:15:02.808268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:02.808555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:02.808835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:02.822239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:02.828263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:02.829752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:02.829870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 515/1010] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:02.898071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 496/1011] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:02 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:03.102553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:03.171358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:03.206118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2b8059-97ef-47f7-93dc-4d30e6837a10 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:03.235984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:03.243125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:03.243778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.244060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.244338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.244932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:03.246306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:03.255387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:03.256409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:03.257259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 516/1012] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:15:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:03.262373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:03.280324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b458f0-7883-42c4-b01a-ccad7e109140 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:03.319009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:03.319646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.319944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.320269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.321331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:03.322789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:03.324531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 497/1013] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:03.329945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:03.334127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:03.378537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9db85c-ff87-47a6-982b-a9abcfe5d9a9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:03.414623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:03.415266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.415554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.415832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.416468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] RBAC: Adding query filter params (name=compute) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:03.416774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:03.418150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:03.423377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 517/1014] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:15:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:03.429680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:03.432230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c17978c-8202-462e-bf1d-789ccda10ef0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:03.470531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:03.471173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.471460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.472308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.473027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:03.474483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:03.495351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:03.502517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 498/1015] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:15:03 2022] POST /identity/v3/projects => generated 311 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:15:03.543948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8d24ce-61c2-46e6-9e60-d920a2b3231d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:03.584807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:03.585496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.585781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.586056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.586782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] RBAC: Adding query filter params (type=compute) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:03.587090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:03.588531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f7e84e-e3cf-4707-b96e-271742cf805a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:03.599221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 518/1016] 10.222.0.39 () {56 vars in 1112 bytes} [Wed Aug 17 23:15:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:03.600860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:03.664231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:03.675750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4810-eb22-433b-8887-dc1b2f9a5af4 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.676047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4810-eb22-433b-8887-dc1b2f9a5af4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.676323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c4810-eb22-433b-8887-dc1b2f9a5af4 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.677800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 519/1017] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:15:03.683192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.684381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.684381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.704194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:03.705390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:03.716575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d698b46d-56d1-4084-9eae-955caad18241 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:03.758303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f6299d-3b2a-4c55-ab76-8cadccf79772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:03.758973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6299d-3b2a-4c55-ab76-8cadccf79772 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:03.759262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6299d-3b2a-4c55-ab76-8cadccf79772 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:03.759625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f6299d-3b2a-4c55-ab76-8cadccf79772 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:03.760170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6299d-3b2a-4c55-ab76-8cadccf79772 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:03.761537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f6299d-3b2a-4c55-ab76-8cadccf79772 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:03.782747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 520/1018] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:03 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:03.783555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 499/1019] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:15:03 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:04.055023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:04.110458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:04.155940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3801bd-5e64-49e4-90dc-5dd9ce6f2f22 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:04.202716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd3d885-9c32-41c5-bf10-367ae7011aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:04.203351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d885-9c32-41c5-bf10-367ae7011aaa None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:04.203631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d885-9c32-41c5-bf10-367ae7011aaa None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:04.203904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd3d885-9c32-41c5-bf10-367ae7011aaa None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:04.204548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d885-9c32-41c5-bf10-367ae7011aaa None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:04.205912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd3d885-9c32-41c5-bf10-367ae7011aaa None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:04.222871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 521/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:15:04 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:05.506967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a6d6f-bbc1-4d72-88db-51f281190d5d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:05.507517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a6d6f-bbc1-4d72-88db-51f281190d5d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:05.507517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a6d6f-bbc1-4d72-88db-51f281190d5d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:05.509154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 500/1021] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:05.514503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18171716-c133-4b79-b31d-14831ffc4e0a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:05.514943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18171716-c133-4b79-b31d-14831ffc4e0a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:05.515122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18171716-c133-4b79-b31d-14831ffc4e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:05.535328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-18171716-c133-4b79-b31d-14831ffc4e0a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:05.536500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-18171716-c133-4b79-b31d-14831ffc4e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:05.611257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 522/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:05.827245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a815c8-ddb9-4063-ab50-7787bb4ef7fb None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:05.827622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a815c8-ddb9-4063-ab50-7787bb4ef7fb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:05.827815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a815c8-ddb9-4063-ab50-7787bb4ef7fb None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:05.829289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 501/1023] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:05.834965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:05.835329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:05.835677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:05.854414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:05.855635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:05.886027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:05.886348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a815c8-ddb9-4063-ab50-7787bb4ef7fb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:05.928563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 523/1024] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:05 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:05.997312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a815c8-ddb9-4063-ab50-7787bb4ef7fb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.011897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:06.036063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bada6148-122f-41f1-b7c5-e77dabf4e7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.036695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada6148-122f-41f1-b7c5-e77dabf4e7b7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.036979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada6148-122f-41f1-b7c5-e77dabf4e7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.037253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bada6148-122f-41f1-b7c5-e77dabf4e7b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.038368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada6148-122f-41f1-b7c5-e77dabf4e7b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.039826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bada6148-122f-41f1-b7c5-e77dabf4e7b7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.042749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 502/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:06.047234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.155788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2760166-b065-46fe-8db8-90128508ec72 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.160828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b712d-e65a-431e-b1be-252cdefd947d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.161119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b712d-e65a-431e-b1be-252cdefd947d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.161401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249b712d-e65a-431e-b1be-252cdefd947d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.165163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 503/1026] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:15:06.167997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.168289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.168570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.187819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:06.189010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:06.201007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.201904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.202212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.202489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.203290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.204811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.230927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 524/1027] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:15:06 2022] POST /identity/v3/users => generated 285 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:06.230927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.258442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:06.271929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 504/1028] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:06 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:06.353399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a2582c-828b-476b-a07c-ac109d45ba33 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.392791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.394278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.394762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.395194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.406322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:06.411102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:06.412207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:06.413129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 525/1029] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:06.418367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.525773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c4151-ff71-46e6-95ff-4dd6662b2e77 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.537488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:06.552862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.563314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.563933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.564224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.564487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.565168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:06.566141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.567531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.576383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 505/1030] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:06.582468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.644575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:06.664756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cb42ab-8a17-4412-8399-0d5408557ec1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.688639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5207aca5-d7d6-4143-b1ad-38dca60a5d4a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.698406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.699084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.699372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.699650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.700239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.701615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:06.711041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:06.712109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:06.713334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 526/1031] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:06.717939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.729378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.730236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.730682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.731141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.742525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.744225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:06.760096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:06.761160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:06.762074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:06.762074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:06.762074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:06.766326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 506/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:06.767536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.800535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:06.830638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cf1185-413e-465a-a42e-707fbd1f87d2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.871926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.872528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.872837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.873086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.873720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] RBAC: Adding query filter params (name=image) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:06.874025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.875436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.880028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc0c85-e9c0-40e7-a956-97645f759c02 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:06.880699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 527/1033] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:06.886112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.899725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:06.920014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:06.920548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:06.920833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:06.921108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:06.921757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:06.922066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:06.923465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:06.935843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 507/1034] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:06.941717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:06.999349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a276962-6d0d-414b-bb42-8e7015eda06b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.034608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.035441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.035893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.036297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:07.036728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.038174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] RBAC: Adding query filter params (type=image) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:07.038633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.040284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.046516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 528/1035] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:07.052529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:07.058067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3326cd6-8838-4e9e-88ff-7e19a9865207 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.099809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.100727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.101164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.101592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] PATH_INFO: `/v3/users/nova` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.109640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.111375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:15:07.124242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:07.125414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:15:07.126592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:07.133565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:07.133752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 508/1036] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:15:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:07.134588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:07.162366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d64cff-45e3-4a26-aed5-1e3cb04ce1d5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.200714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.201240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.201524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.201889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.202493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] RBAC: Adding query filter params (interface=public, service_id=3c077208a16d4fffbebe27da59e83a8a, region_id=RegionOne) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:07.202836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.204205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.211535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 529/1037] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/endpoints?service_id=3c077208a16d4fffbebe27da59e83a8a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:07.216658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:07.243572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc73304-8f04-4727-9cb0-677f8620ba17 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.288414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.289239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.289504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.289817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.290987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:07.290987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.292266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.317694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 509/1038] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:07.318738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:07.321472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:07.336745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07036ef-dd97-4c95-b1ab-e1a485f437b5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.373728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.374846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.375405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.375917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.376624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.378866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.386203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 530/1039] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/services => generated 1957 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:15:07.434211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde54a31-7ed0-4c4d-9a47-ce30cddd0476 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.473063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.473987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.474451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.474951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.551252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.552699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.554574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:07.661162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 510/1040] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:07.662890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:07.666044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:07.767090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3732b0cf-9da8-4d40-92c2-ab58be336e6e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.801627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.802257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.802541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.802844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.813518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.814997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:07.829587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:07.830569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:07.832703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:07.832703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:07.832703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:07.835032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 531/1041] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:07.837070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:07.940123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21e944e-31f0-4178-a9c8-6edf50610624 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:07.942425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:07.976413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:07.977019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:07.977299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:07.977574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:07.978215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:07.978519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:07.979892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:07.995757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 511/1042] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:07.997644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:08.055624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:08.101754 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2bf72-2540-48b7-952c-8b3b62f8bf3c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:08.135388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:08.136012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.136289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.136556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.143026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:08.145385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-9e0835e0-c0c7-49be-8f98-c3754b4f4470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:15:08.156520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:08.157449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:08.163775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 532/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:08.165966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:08.244148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd38df7-931f-46ef-a3e5-bde2dd20ae75 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.244428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd38df7-931f-46ef-a3e5-bde2dd20ae75 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.244701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd38df7-931f-46ef-a3e5-bde2dd20ae75 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.246024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 533/1044] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:15:08.250799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.251088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.251364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.270333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:08.271627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:08.280830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8995f-23e0-4ca3-8a9f-95f870415677 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:08.322113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:08.322639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.322946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.323218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.323910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:08.324213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:08.325630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:08.337890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 512/1045] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:15:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:08.343771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:08.359157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 534/1046] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:08 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:08.369207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:08.446124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d698c-273f-4c7d-8c57-2a857d1a2b8c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:08.481549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:08.482172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.482451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.482749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.483488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] RBAC: Adding query filter params (role.id=8691b7c789e44d9ea32342db0aa18e15, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8ba4d7dcfc6248118c0100c91a8e0236) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:08.483796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:08.485228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:08.492396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 513/1047] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:08 2022] GET /identity/v3/role_assignments?user.id=8ba4d7dcfc6248118c0100c91a8e0236&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=8691b7c789e44d9ea32342db0aa18e15 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:08.623793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:08.670584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:08.724739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33740e-0ee8-4262-ac2c-eb40eaf08e1c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:08.758855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:08.759493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.759778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.760055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.770265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:08.774917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:08.776107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:08.779478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 535/1048] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:08.782854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:08.869951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:08.886148 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16e71a9-a40b-4ad5-ab4c-9b7854494511 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:08.920614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:08.921223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:08.921506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:08.921784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:08.922454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:08.922786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:08.924153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:08.938049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 514/1049] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:08.939766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:09.044897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e83e6c-deff-44a4-a870-3ecd289ff28c None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:09.047268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:09.079753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ca1f71-732f-4bd5-a689-0859c84748c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:09.080391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1f71-732f-4bd5-a689-0859c84748c7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.080672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1f71-732f-4bd5-a689-0859c84748c7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.081594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ca1f71-732f-4bd5-a689-0859c84748c7 None admin] PATH_INFO: `/v3/users/afcf8f31d87949519121c68a3b4088ac` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.094668 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca1f71-732f-4bd5-a689-0859c84748c7 None admin] RBAC: Authorizing `identity:get_user(user_id=afcf8f31d87949519121c68a3b4088ac)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:09.096151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ca1f71-732f-4bd5-a689-0859c84748c7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:09.102936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 536/1050] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:08 2022] GET /identity/v3/users/afcf8f31d87949519121c68a3b4088ac => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:09.104455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:09.205541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7193d-9096-4401-9c88-cc27d4e9700f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:09.239759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:09.240376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.240660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.240936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.258786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:09.319821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910cd53-a881-4214-8998-9e07826d9246 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.320108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910cd53-a881-4214-8998-9e07826d9246 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.320396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910cd53-a881-4214-8998-9e07826d9246 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.321863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 537/1051] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:09.322239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:09.323794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:09.326499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.326820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.327108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.347511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:09.348698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:09.420063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 538/1052] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:09.440812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 515/1053] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:09 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:15:09.442670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:09.535631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:09.545094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24845bc0-ad2d-409e-818d-168c61609459 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:09.579941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:09.580589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.580954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.581350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.582809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] RBAC: Authorizing `identity:get_project(project_id=2641693e47b349b5b4295b5429b18421)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:09.584255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:09.590943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 539/1054] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:09 2022] GET /identity/v3/projects/2641693e47b349b5b4295b5429b18421 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:09.592454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:09.642446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:09.687969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:09.716432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49074d6c-6b88-46df-beeb-005ab68baebc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:09.756818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:09.757492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.757785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.758063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.758822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=2641693e47b349b5b4295b5429b18421, user.id=afcf8f31d87949519121c68a3b4088ac) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:09.759139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:09.760594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:09.767936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 516/1055] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:09 2022] GET /identity/v3/role_assignments?user.id=afcf8f31d87949519121c68a3b4088ac&scope.project.id=2641693e47b349b5b4295b5429b18421&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:09.821246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272f6ec-f70c-483c-87b2-3884ab64231d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:09.861884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:09.866064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:09.866064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:09.866064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] PATH_INFO: `/v3/services/image` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:09.866064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:09.866064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:09.875724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:09.876811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 17 23:15:09.877722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:09.883377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:09.884086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 540/1056] 10.222.0.39 () {56 vars in 1105 bytes} [Wed Aug 17 23:15:09 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:10.007332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9820ec-f2d5-40ef-824a-3718cbb8a72f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:10.024214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:10.052800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:10.053880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:10.054520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:10.055209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:10.056230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] RBAC: Adding query filter params (name=image) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:10.056535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:10.059496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:10.066245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 517/1057] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:10.071958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:10.104963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:10.183072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8150ed-d936-4ca3-97d9-62bd97c14dc6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:10.223479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:10.224094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:10.224378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:10.224654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:10.225293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] RBAC: Adding query filter params (type=image) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:10.225599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:10.226996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ab7a4-f89d-41c1-86a2-183da2cd80b8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:10.236593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 541/1058] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:10 2022] GET /identity/v3/services?type=image => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:10.238786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:10.349387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fc80fa-5165-4f99-9716-cb8564082d1b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:10.382894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039ec00-a72e-4568-9a97-74d7d8d89e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:10.383509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039ec00-a72e-4568-9a97-74d7d8d89e4f None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:10.383793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039ec00-a72e-4568-9a97-74d7d8d89e4f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:10.384073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039ec00-a72e-4568-9a97-74d7d8d89e4f None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:10.384732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039ec00-a72e-4568-9a97-74d7d8d89e4f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:10.386107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039ec00-a72e-4568-9a97-74d7d8d89e4f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:10.414747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 518/1059] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:15:10 2022] POST /identity/v3/endpoints => generated 327 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:15:10.429042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13a5d8-aa4e-441e-adbc-6c9e3e44821b None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:10.429359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13a5d8-aa4e-441e-adbc-6c9e3e44821b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:10.429606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d13a5d8-aa4e-441e-adbc-6c9e3e44821b None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:10.431083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 542/1060] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:10.437132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:10.437423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:10.437699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:10.461691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:10.463263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:10.494250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:10.551077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 519/1061] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:10.822154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13a5d8-aa4e-441e-adbc-6c9e3e44821b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:10.916957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:10.931727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d13a5d8-aa4e-441e-adbc-6c9e3e44821b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:10.965435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:10.966069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:10.966354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:10.966630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:10.977240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:10.981885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:10.982835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:10.987818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 543/1062] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 17 23:15:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:10.989781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:11.092943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a60885-473c-4a32-8f5a-e8421ff3a92d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:11.127382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:11.128626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.128959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.129240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.129910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:11.130216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:11.131662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:11.144652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 520/1063] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:15:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:11.145845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:11.248707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e2cae-2714-44d3-b131-4384dcc36e47 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:11.291429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:11.292075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.292355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.292628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.303964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:11.305451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:11.314596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:11.321952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:11.323159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:11.324196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:11.324196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:11.324196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:11.330625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 544/1064] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:11.331932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:11.355642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:11.447520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b629e91-0383-4447-a5b4-e76dd0e8a241 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:11.481178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:11.481791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.482129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.482409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.483093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:11.483401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:11.484757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:11.501366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 521/1065] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:11.503308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:11.606058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e91419-cc44-46bb-bd7e-cfb69957bac9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:11.640298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:11.640930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.641213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.641488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] PATH_INFO: `/v3/users/nova` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.648976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:11.650675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-bb847de2-1532-4778-98e0-27e8b732b660 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:15:11.662037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:11.667857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:11.668815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 545/1066] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:15:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:11.670505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:11.694512 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809af7-bce7-4ff8-b839-9750aa07bf36 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.694771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809af7-bce7-4ff8-b839-9750aa07bf36 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.695033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79809af7-bce7-4ff8-b839-9750aa07bf36 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.696506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 546/1067] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:15:11.701074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.701380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.701638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.720326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:11.722689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:11.758299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:11.781962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:11.782861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfb4ccb-152e-46ea-b3e5-18989644c232 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:11.796256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 547/1068] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:11.824238 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:11.824906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.825189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.825464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:11.826193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:11.826500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:11.827965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:11.850766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 522/1069] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:15:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:11.852521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:11.955412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d1a69-6e32-4b41-8318-d2e28b3a5a54 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:11.990759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:11.991398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:11.991683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:11.991957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.002133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.004076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:12.019208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:12.020256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:12.021164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:12.021164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:12.021164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:12.022036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 548/1070] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:12.026398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.068658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.116390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.141449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81dac09-5262-4622-8fca-94667b98738e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.180133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d0acf-5b94-4c05-bbb8-481cff77a2b5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.181019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.181633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.181918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.182196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.183122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:12.183234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.184531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.194918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.203313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 523/1071] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:12.204201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.217700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.218264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.218547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.218852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.231929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:12.238541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:12.239614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:12.240479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:12.241123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 549/1072] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:12.246120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.323325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165a7c9-e03e-4e66-b188-3478872a5d01 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.356929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f298903d-d972-46e5-a043-594dc5aea9f6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.358501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.358758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.359422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.359712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.359982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.367236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.368669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-fbbf6eb6-1c89-4d44-b808-908f9e5136ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:15:12.379703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:12.380752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:12.381675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 524/1073] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:12.382296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402903-43f4-4a2d-8f03-3e2d33b61e8f None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.382525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402903-43f4-4a2d-8f03-3e2d33b61e8f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.382826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50402903-43f4-4a2d-8f03-3e2d33b61e8f None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.384175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 525/1074] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:12.386534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402903-43f4-4a2d-8f03-3e2d33b61e8f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.394844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.395462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.395748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.396133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.396809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:12.397118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.398510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4099a108-19db-44f3-a2c7-3e387046a891 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.415275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 550/1075] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:12.415275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4231b-a13e-423b-8103-79b813505515 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.415275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4231b-a13e-423b-8103-79b813505515 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.415275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4231b-a13e-423b-8103-79b813505515 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.431401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-fee4231b-a13e-423b-8103-79b813505515 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:12.432602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fee4231b-a13e-423b-8103-79b813505515 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:12.449330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.492614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50402903-43f4-4a2d-8f03-3e2d33b61e8f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.497090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 551/1076] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:12.497916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4231b-a13e-423b-8103-79b813505515 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.527522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.528132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.528416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.528696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.529395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:12.529722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.531170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.543407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 526/1077] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:12.549254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.601873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.609659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4231b-a13e-423b-8103-79b813505515 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.647121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.647887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.648169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.648442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] PATH_INFO: `/v3/users/afcf8f31d87949519121c68a3b4088ac` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.649567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] RBAC: Authorizing `identity:get_user(user_id=afcf8f31d87949519121c68a3b4088ac)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.651509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.656529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515abf35-36a4-481e-b8c1-99bc9b0c6e41 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.658019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 552/1078] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/users/afcf8f31d87949519121c68a3b4088ac => generated 285 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:12.659737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.674902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.694548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.695231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.695517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.695791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8ba4d7dcfc6248118c0100c91a8e0236/roles/8691b7c789e44d9ea32342db0aa18e15` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.697919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=8ba4d7dcfc6248118c0100c91a8e0236, role_id=8691b7c789e44d9ea32342db0aa18e15)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.699377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.713230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 527/1079] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:15:12 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/8ba4d7dcfc6248118c0100c91a8e0236/roles/8691b7c789e44d9ea32342db0aa18e15 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:15:12.775983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.783464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bd94d-304e-496f-8b1f-e0b026386fce None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.824224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.824874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.825157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.825433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.826617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] RBAC: Authorizing `identity:get_project(project_id=2641693e47b349b5b4295b5429b18421)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.828348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:12.835670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 553/1080] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/projects/2641693e47b349b5b4295b5429b18421 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:12.837344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:12.875959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.895091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609c740-a233-4121-a309-f1bdd8da6707 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.930525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.931174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.931453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.931724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.948681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96148bb9-0e47-4580-a13b-089b96e31055 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:12.977928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:12.986314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:12.987547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:12.987837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:12.988114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421/users/afcf8f31d87949519121c68a3b4088ac/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:12.990046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] RBAC: Authorizing `identity:create_grant(project_id=2641693e47b349b5b4295b5429b18421, user_id=afcf8f31d87949519121c68a3b4088ac, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:12.991514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:13.003377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:13.004825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:13.005910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 554/1081] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:15:12 2022] PUT /identity/v3/projects/2641693e47b349b5b4295b5429b18421/users/afcf8f31d87949519121c68a3b4088ac/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:15:13.121434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 528/1082] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:15:13.127290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:13.226097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:13.237364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6a4cce-d7aa-4940-9b7f-2e2eae053941 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:13.272332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:13.272969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:13.273308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:13.273589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:13.290596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:13.292127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-c2b33d50-c400-4e35-8c3c-a47f5d52ebfa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:13.307087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:13.308083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:13.314115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:13.314115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:13.314115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:13.314115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 555/1083] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:13.316870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:13.398431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:13.421854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1ba72-b1b6-40e3-8c84-28ba46bff973 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:13.461501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:13.462113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:13.462395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:13.462668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:13.463345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:13.463650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:13.465009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c2f86d-669f-44ab-8304-17f979de40d7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:13.477120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 529/1084] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:14.645675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8e2e-29cb-45a2-92f9-4a9e8e34ed71 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:14.646210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8e2e-29cb-45a2-92f9-4a9e8e34ed71 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:14.646210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8f8e2e-29cb-45a2-92f9-4a9e8e34ed71 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:14.647497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 556/1085] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:14.652914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa04d2-5b75-48d4-86bc-e1810875b7bc None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:14.653295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa04d2-5b75-48d4-86bc-e1810875b7bc None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:14.653592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa04d2-5b75-48d4-86bc-e1810875b7bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:14.672239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-07fa04d2-5b75-48d4-86bc-e1810875b7bc None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:14.673430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-07fa04d2-5b75-48d4-86bc-e1810875b7bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:14.739798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 530/1086] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:14.922401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7959c-9b14-45ba-92d4-0e480204cd63 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:14.922618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7959c-9b14-45ba-92d4-0e480204cd63 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:14.922946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7959c-9b14-45ba-92d4-0e480204cd63 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:14.924278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 557/1087] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:14.930000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:14.930287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:14.930559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:14.949579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:14.950776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:15.008751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7959c-9b14-45ba-92d4-0e480204cd63 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.011111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.017321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 531/1088] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:15.109036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7959c-9b14-45ba-92d4-0e480204cd63 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.141080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.141708 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.141995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.142272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.152758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:15.157400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:15.158326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:15.159368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 558/1089] 10.222.0.39 () {56 vars in 1120 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:15.164510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.261500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41f6c22-b687-4896-9990-02c440a3e30e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.291228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.294619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.297248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.297860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.298139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.298410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.299120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:15.299545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.301288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.309443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 532/1090] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:15.315365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.373652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.392292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac2d7c-3cbe-4d68-871d-cd7654f78b4f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.415995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b15f3e6-6e13-45c9-9964-4263f1e97232 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.430067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.430733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.431013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.431292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.441784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:15.446548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:15.447527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:15.448371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 559/1091] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:15.450933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.451565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.451879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.452152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.453571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.463449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.464937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:15.478960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:15.479924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:15.480856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:15.480856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:15.480856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:15.480856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 533/1092] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:15.485863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.514118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.552929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d52e6b2-0aae-4e99-bddd-f77ca4bd5e79 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.585947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.586128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654e5773-0677-4a9a-8915-bc0416debd82 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.586551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.586871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.587147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.587807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:15.588110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.589485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.598738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 560/1093] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:15.601052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.603941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.623565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.624170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.624454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.624730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.625369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:15.625673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.627063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.638715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 534/1094] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:15.644297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.703501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3b7717-d06f-43ac-be4f-5473380d54b0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.726519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.737417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.738089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.738367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.738640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] PATH_INFO: `/v3/users/afcf8f31d87949519121c68a3b4088ac` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.739799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] RBAC: Authorizing `identity:get_user(user_id=afcf8f31d87949519121c68a3b4088ac)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.741219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.742528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb362fdd-3422-4029-8bf4-0d8a8e4f2ddd None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.743096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 561/1095] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/users/afcf8f31d87949519121c68a3b4088ac => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:15.748486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.777169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.777732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.778021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.778298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] PATH_INFO: `/v3/users/nova` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.785322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.786786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:15:15.799232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:15.801249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:15.802515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 535/1096] 10.222.0.39 () {56 vars in 1093 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:15.806499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:15.837584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.851297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf690b-defa-4f1a-b634-c22b9460f761 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.884558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.885165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.885453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.885734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.906140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54de2b78-3412-4e32-81ce-00e34c1f45bb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:15.940782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:15.941386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:15.941667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:15.941939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:15.942659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:15.942993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.944412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.944794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:15.954657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:15.956854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:15.961933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 536/1097] 10.222.0.39 () {56 vars in 1133 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:15.967719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.055745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:16.056439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 562/1098] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:15:16.062037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.066198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40bc29-83bb-4700-b01a-5b20c6d84368 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.099606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.100199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.100478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.100749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.149353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:16.158394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d8f65b-e315-48cf-a3dd-3931b2d10a1e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.166694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.168158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.192424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.193048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.193335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.193607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.194765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] RBAC: Authorizing `identity:get_project(project_id=2641693e47b349b5b4295b5429b18421)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.196146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.198150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 563/1099] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/projects/2641693e47b349b5b4295b5429b18421 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:16.203698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.262468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:16.273688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 537/1100] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:15:16.279895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.303300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15527cc-9c48-4caa-a9ac-acf50e5011b3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.336435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.336966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.337245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.337518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.338237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=2641693e47b349b5b4295b5429b18421, user.id=afcf8f31d87949519121c68a3b4088ac) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:16.338541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.339993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.345469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 564/1101] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/role_assignments?user.id=afcf8f31d87949519121c68a3b4088ac&scope.project.id=2641693e47b349b5b4295b5429b18421&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:15:16.384446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3bcd77-f3e1-4871-b9f8-c3619503c09e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.420852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.421480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.421761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.422032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.433020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.434483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:16.450669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:16.451810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:15:16.452697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:16.452697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:15:16.452697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:16.452697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 538/1102] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:15:16.458588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.484759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:16.563704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36601a6d-232e-4ac1-9cbb-4363d872c333 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.598609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.599241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.599567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.599905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.600601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:16.600936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.602387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.614896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 565/1103] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:16.620489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.664041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:16.721405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bddcd81-e94a-4f56-9f70-edd8ee9c8ec8 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.755319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.755941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.756221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.756496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.763050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.764483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:15:16.775859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:16.776910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:16.777818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 539/1104] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:16.782801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:16.865003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:16.881248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1392c279-339c-472f-9614-9c98cca77ab0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:16.914442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:16.915077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:16.915361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:16.915636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:16.916327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:16.916635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:16.918059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33d50d8-7f80-4a53-a84c-f2045d4f3291 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:16.929586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 566/1105] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:16.935835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:17.035022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f452a5fe-4948-4f41-b658-1082d1a926ea None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:17.036562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:17.069328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:17.069930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:17.070212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:17.070487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:17.071248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] RBAC: Adding query filter params (role.id=8691b7c789e44d9ea32342db0aa18e15, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=8ba4d7dcfc6248118c0100c91a8e0236) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:17.071562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:17.072983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3493da-9fca-46a3-b69c-13282d02949d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:17.078600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 540/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:16 2022] GET /identity/v3/role_assignments?user.id=8ba4d7dcfc6248118c0100c91a8e0236&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=8691b7c789e44d9ea32342db0aa18e15 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:18.283432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc6a-7d8a-4e5b-bb59-bf4c2dc6af9d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:18.283978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc6a-7d8a-4e5b-bb59-bf4c2dc6af9d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:18.284296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceafc6a-7d8a-4e5b-bb59-bf4c2dc6af9d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:18.285692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 567/1107] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:18.290974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:18.291360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:18.291537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:18.309610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:18.310845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:18.376089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 541/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:18.647217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceafc6a-7d8a-4e5b-bb59-bf4c2dc6af9d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:18.746939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceafc6a-7d8a-4e5b-bb59-bf4c2dc6af9d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:18.779923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dbc6a8-7527-42e3-a2c9-d25c0a844b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:18.780541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbc6a8-7527-42e3-a2c9-d25c0a844b4b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:18.780825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbc6a8-7527-42e3-a2c9-d25c0a844b4b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:18.781102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dbc6a8-7527-42e3-a2c9-d25c0a844b4b None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:18.782201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbc6a8-7527-42e3-a2c9-d25c0a844b4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:18.783842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dbc6a8-7527-42e3-a2c9-d25c0a844b4b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:18.789177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 568/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:18.795720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:18.886805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:18.892800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53261d6c-b546-4d38-be4f-978804a15232 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:18.926037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ab1e3a-1ca9-466e-b813-7fcce720ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:18.926569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1e3a-1ca9-466e-b813-7fcce720ce31 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:18.926883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1e3a-1ca9-466e-b813-7fcce720ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:18.927164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ab1e3a-1ca9-466e-b813-7fcce720ce31 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:18.927816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1e3a-1ca9-466e-b813-7fcce720ce31 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:18.929240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ab1e3a-1ca9-466e-b813-7fcce720ce31 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:18.949161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 542/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:15:18 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:15:20.903831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbadd4-5c66-438f-8c42-e0487af457b9 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:20.904383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbadd4-5c66-438f-8c42-e0487af457b9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:20.904383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fbadd4-5c66-438f-8c42-e0487af457b9 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:20.905688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 569/1111] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:20.911659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:20.912041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:20.912208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:20.930380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:20.931584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:20.995807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 543/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:21.266240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbadd4-5c66-438f-8c42-e0487af457b9 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:21.281991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:21.366354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fbadd4-5c66-438f-8c42-e0487af457b9 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:21.399298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:21.399917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:21.400200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:21.400730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] PATH_INFO: `/v3/roles/8c530229735042e8958733424a56358b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:21.402099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] RBAC: Authorizing `identity:get_role(role_id=8c530229735042e8958733424a56358b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:21.403493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:21.404794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 570/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:21 2022] GET /identity/v3/roles/8c530229735042e8958733424a56358b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:21.411003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:21.494103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:21.513447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c2bd5-646f-489c-9823-2d1d1070b4b9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:21.547217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:21.547834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:21.548114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:21.548386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] PATH_INFO: `/v3/users/5f3aebf6144540f5a8dc5917540ee24a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:21.560991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] RBAC: Authorizing `identity:get_user(user_id=5f3aebf6144540f5a8dc5917540ee24a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:21.562414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:21.564028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 544/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:21 2022] GET /identity/v3/users/5f3aebf6144540f5a8dc5917540ee24a => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:21.570436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:21.653379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:21.672983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148189fd-c2e1-4cfb-9117-d3dcff901cc9 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:21.705963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:21.706565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:21.706881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:21.707162 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:21.772106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:21.773564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:21.852940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:21.871933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 571/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:21.878476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:21.984656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225d59-f8c7-46de-9c59-53b92d44f496 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:22.018799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe4029-a26a-4a40-8625-fc5385c5c9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:22.019422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4029-a26a-4a40-8625-fc5385c5c9c8 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:22.019704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4029-a26a-4a40-8625-fc5385c5c9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:22.019981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe4029-a26a-4a40-8625-fc5385c5c9c8 None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:22.021086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe4029-a26a-4a40-8625-fc5385c5c9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=2641693e47b349b5b4295b5429b18421)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:22.022507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe4029-a26a-4a40-8625-fc5385c5c9c8 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:22.024158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 545/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:21 2022] GET /identity/v3/projects/2641693e47b349b5b4295b5429b18421 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:22.030589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:22.147234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0566257d-38f3-4a92-b4cb-3e5a662aa6a6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:22.187863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:22.188466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:22.188750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:22.189025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:22.189821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] RBAC: Adding query filter params (role.id=8c530229735042e8958733424a56358b, scope.project.id=2641693e47b349b5b4295b5429b18421, user.id=5f3aebf6144540f5a8dc5917540ee24a) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:22.190315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:22.191743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d65265-882f-481a-9a98-6092b73138ad None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:22.197774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 572/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:22 2022] GET /identity/v3/role_assignments?user.id=5f3aebf6144540f5a8dc5917540ee24a&scope.project.id=2641693e47b349b5b4295b5429b18421&role.id=8c530229735042e8958733424a56358b => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:24.117060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdd6eb-b6e2-406f-8c30-f0e0c5d4436b None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:24.117618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdd6eb-b6e2-406f-8c30-f0e0c5d4436b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:24.117618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cdd6eb-b6e2-406f-8c30-f0e0c5d4436b None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:24.118977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 546/1118] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:24.124109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:24.124552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:24.124651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:24.142998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:24.144409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:24.183889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:24.210251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 573/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:24.480434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdd6eb-b6e2-406f-8c30-f0e0c5d4436b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:24.491877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:24.580606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cdd6eb-b6e2-406f-8c30-f0e0c5d4436b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:24.613394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:24.614009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:24.614319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:24.614594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] PATH_INFO: `/v3/roles/8c530229735042e8958733424a56358b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:24.616000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] RBAC: Authorizing `identity:get_role(role_id=8c530229735042e8958733424a56358b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:24.617364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:24.618672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 547/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:24 2022] GET /identity/v3/roles/8c530229735042e8958733424a56358b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:24.624498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:24.719251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56908185-3753-4899-96e7-df7bee5fb4da None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:24.752092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:24.752759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:24.753048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:24.753325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] PATH_INFO: `/v3/users/5f3aebf6144540f5a8dc5917540ee24a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:24.754441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] RBAC: Authorizing `identity:get_user(user_id=5f3aebf6144540f5a8dc5917540ee24a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:24.755904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:24.757472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 574/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:24 2022] GET /identity/v3/users/5f3aebf6144540f5a8dc5917540ee24a => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:24.763117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:24.839026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:24.861224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b73b20-ee62-4996-97ac-6c2d5e0111b5 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:24.895077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf68691-9a94-4e5d-9824-0034c5a12c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:24.895785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68691-9a94-4e5d-9824-0034c5a12c92 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:24.896072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68691-9a94-4e5d-9824-0034c5a12c92 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:24.896350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf68691-9a94-4e5d-9824-0034c5a12c92 None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:24.897739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68691-9a94-4e5d-9824-0034c5a12c92 None admin] RBAC: Authorizing `identity:get_project(project_id=2641693e47b349b5b4295b5429b18421)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:24.899481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf68691-9a94-4e5d-9824-0034c5a12c92 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:24.901357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 548/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:24 2022] GET /identity/v3/projects/2641693e47b349b5b4295b5429b18421 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:24.907261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:24.949384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:25.005330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc8667b-6ff0-4ddf-a8fe-a8c0f3837ceb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:25.038300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba01925-de95-4da3-ad67-bb84723a20f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:25.038970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01925-de95-4da3-ad67-bb84723a20f1 None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:25.039256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01925-de95-4da3-ad67-bb84723a20f1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:25.039532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba01925-de95-4da3-ad67-bb84723a20f1 None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421/users/5f3aebf6144540f5a8dc5917540ee24a/roles/8c530229735042e8958733424a56358b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:25.041622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01925-de95-4da3-ad67-bb84723a20f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=2641693e47b349b5b4295b5429b18421, user_id=5f3aebf6144540f5a8dc5917540ee24a, role_id=8c530229735042e8958733424a56358b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:25.043084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba01925-de95-4da3-ad67-bb84723a20f1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:25.055073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 575/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:15:24 2022] PUT /identity/v3/projects/2641693e47b349b5b4295b5429b18421/users/5f3aebf6144540f5a8dc5917540ee24a/roles/8c530229735042e8958733424a56358b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:15:26.949939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142555fc-098a-4620-a950-5340a16cda3e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:26.950470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142555fc-098a-4620-a950-5340a16cda3e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:26.950470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142555fc-098a-4620-a950-5340a16cda3e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:26.951875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 549/1124] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:26.957762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:26.958175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:26.958317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:26.976490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:26.977694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:27.044597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 576/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:27.320738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142555fc-098a-4620-a950-5340a16cda3e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:27.420760 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142555fc-098a-4620-a950-5340a16cda3e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:27.457105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:27.457724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:27.458006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:27.458280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] PATH_INFO: `/v3/roles/8c530229735042e8958733424a56358b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:27.459675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] RBAC: Authorizing `identity:get_role(role_id=8c530229735042e8958733424a56358b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:27.461044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:27.462402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 550/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:27 2022] GET /identity/v3/roles/8c530229735042e8958733424a56358b => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:27.468182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:27.497372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:27.566337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0c0928-65fc-4b68-a3f3-c1c70306c0af None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:27.599030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:27.599658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:27.599946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:27.600219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] PATH_INFO: `/v3/users/5f3aebf6144540f5a8dc5917540ee24a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:27.601327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] RBAC: Authorizing `identity:get_user(user_id=5f3aebf6144540f5a8dc5917540ee24a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:27.602793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:27.604365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 577/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:27 2022] GET /identity/v3/users/5f3aebf6144540f5a8dc5917540ee24a => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:27.610181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:27.624927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:27.707457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b27d7e2-85d1-4f1d-bb45-2ae4ac43f00b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:27.747007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:27.747615 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:27.747900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:27.748178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:27.814751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:27.816194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:27.829086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:27.912135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 551/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:27.918087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:28.010444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:28.013353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d60fc0a-6115-4eaf-b1ae-0276657cfac5 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:28.047825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133396a3-793a-414f-b9c3-759f1e85fd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:28.048446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133396a3-793a-414f-b9c3-759f1e85fd9e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:28.048727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133396a3-793a-414f-b9c3-759f1e85fd9e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:28.049687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133396a3-793a-414f-b9c3-759f1e85fd9e None admin] PATH_INFO: `/v3/projects/2641693e47b349b5b4295b5429b18421` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:28.050818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133396a3-793a-414f-b9c3-759f1e85fd9e None admin] RBAC: Authorizing `identity:get_project(project_id=2641693e47b349b5b4295b5429b18421)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:28.052240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133396a3-793a-414f-b9c3-759f1e85fd9e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:28.053838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 578/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:27 2022] GET /identity/v3/projects/2641693e47b349b5b4295b5429b18421 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:28.060140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:28.157662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdeca2c-d1c0-42b5-b35d-78be0a493409 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:28.171096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:28.192345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:28.192939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:28.193225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:28.193500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:28.194218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] RBAC: Adding query filter params (role.id=8c530229735042e8958733424a56358b, scope.project.id=2641693e47b349b5b4295b5429b18421, user.id=5f3aebf6144540f5a8dc5917540ee24a) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:28.194527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:28.195971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c608f2b1-5f43-4cca-a348-cbfd5eed30af None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:28.201531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 552/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:28 2022] GET /identity/v3/role_assignments?user.id=5f3aebf6144540f5a8dc5917540ee24a&scope.project.id=2641693e47b349b5b4295b5429b18421&role.id=8c530229735042e8958733424a56358b => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:30.110134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf51-40b9-49cc-b6c0-5a7f4f4c2d91 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:30.110688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf51-40b9-49cc-b6c0-5a7f4f4c2d91 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:30.110688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fbcf51-40b9-49cc-b6c0-5a7f4f4c2d91 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:30.112664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 579/1131] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:30.117758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:30.118172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:30.118301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:30.136630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:30.137799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:30.204871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 553/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:30.473608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf51-40b9-49cc-b6c0-5a7f4f4c2d91 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:30.572609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fbcf51-40b9-49cc-b6c0-5a7f4f4c2d91 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:30.605462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8da5194-d485-4641-9352-d549cee4a22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:30.606074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da5194-d485-4641-9352-d549cee4a22a None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:30.606354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da5194-d485-4641-9352-d549cee4a22a None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:30.606626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8da5194-d485-4641-9352-d549cee4a22a None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:30.607740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da5194-d485-4641-9352-d549cee4a22a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:30.609186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8da5194-d485-4641-9352-d549cee4a22a None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:30.610727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 580/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:30.617089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:30.711739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0875e-1334-42ce-a85c-04a2b5cb81d6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:30.718741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:30.745555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccdf0e-db24-4b8c-bcd1-89b5b3e8118f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:30.746096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccdf0e-db24-4b8c-bcd1-89b5b3e8118f None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:30.746379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccdf0e-db24-4b8c-bcd1-89b5b3e8118f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:30.746654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccdf0e-db24-4b8c-bcd1-89b5b3e8118f None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:30.747328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccdf0e-db24-4b8c-bcd1-89b5b3e8118f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:30.748752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccdf0e-db24-4b8c-bcd1-89b5b3e8118f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:30.775486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 554/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:15:30 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:15:32.682414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1656c1-7e95-45d0-a760-1bd7daa3e5c4 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:32.682970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1656c1-7e95-45d0-a760-1bd7daa3e5c4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:32.682970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1656c1-7e95-45d0-a760-1bd7daa3e5c4 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:32.684255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 581/1135] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:32.689778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:32.690384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:32.690384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:32.708552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:32.709767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:32.774444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 555/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:33.042121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1656c1-7e95-45d0-a760-1bd7daa3e5c4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:33.077480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:33.141096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1656c1-7e95-45d0-a760-1bd7daa3e5c4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:33.173225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99315b-f85d-421e-b38f-a04cc42405b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:33.174370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99315b-f85d-421e-b38f-a04cc42405b8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:33.174647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99315b-f85d-421e-b38f-a04cc42405b8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:33.174942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99315b-f85d-421e-b38f-a04cc42405b8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:33.176039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99315b-f85d-421e-b38f-a04cc42405b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:33.177455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d99315b-f85d-421e-b38f-a04cc42405b8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:33.179008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 582/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:15:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:33.184800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:33.271310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:33.284649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40c17d-0dc4-473b-a1d9-81d3b240c472 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:33.321045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df6ebc-cb4d-406d-82b5-9e0d85af2d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:33.321584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df6ebc-cb4d-406d-82b5-9e0d85af2d87 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:33.321864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df6ebc-cb4d-406d-82b5-9e0d85af2d87 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:33.322135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df6ebc-cb4d-406d-82b5-9e0d85af2d87 None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:33.322811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df6ebc-cb4d-406d-82b5-9e0d85af2d87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:33.324272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df6ebc-cb4d-406d-82b5-9e0d85af2d87 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:33.344193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 556/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:15:33 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:35.276953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71619f1-39e3-4891-ac1a-433030535e08 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:35.277504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71619f1-39e3-4891-ac1a-433030535e08 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:35.277504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71619f1-39e3-4891-ac1a-433030535e08 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:35.278880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 583/1139] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:35.284943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:35.285386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:35.285526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:35.303395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:35.304571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:35.369572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 557/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:15:35.647382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71619f1-39e3-4891-ac1a-433030535e08 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:35.745761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71619f1-39e3-4891-ac1a-433030535e08 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:35.748100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:35.783981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:35.784633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:35.784915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:35.785187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:35.794911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:35.800493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:35.801676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:35.802935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 584/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:35.807652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:35.880233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:35.905832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f28c1b-80ec-4ac0-99f2-5215b9d037e3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:35.938522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:35.939669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:35.940170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:35.940447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:35.941117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:35.941423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:35.942817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:35.950593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 558/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:35.957081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:36.053887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f66bf2-ad3f-41c5-9194-d791df28a4c0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:36.088673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:36.089279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:36.089563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:36.089840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] PATH_INFO: `/v3/users/3473e14bb619457aa4423ab47ee0ee4a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:36.103007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] RBAC: Authorizing `identity:get_user(user_id=3473e14bb619457aa4423ab47ee0ee4a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:36.104457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:36.106037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 585/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:35 2022] GET /identity/v3/users/3473e14bb619457aa4423ab47ee0ee4a => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:36.111854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:36.211180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de4675-92e1-4ce0-8f98-4f335828f2ca None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:36.244273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:36.244879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:36.245163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:36.245437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:36.248738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:36.312142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:36.313584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:36.409668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 559/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:36.415528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:36.438666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:36.516255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7d083-bf34-4f3d-a378-9e606a5acbb4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:36.549882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6414fb0-8fbc-4743-acbe-3656818a5b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:36.550500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414fb0-8fbc-4743-acbe-3656818a5b6f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:36.550809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414fb0-8fbc-4743-acbe-3656818a5b6f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:36.551081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6414fb0-8fbc-4743-acbe-3656818a5b6f None admin] PATH_INFO: `/v3/projects/914b6fff20424d86aab269239da5d064` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:36.552168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6414fb0-8fbc-4743-acbe-3656818a5b6f None admin] RBAC: Authorizing `identity:get_project(project_id=914b6fff20424d86aab269239da5d064)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:36.553585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6414fb0-8fbc-4743-acbe-3656818a5b6f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:36.555214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 586/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:36 2022] GET /identity/v3/projects/914b6fff20424d86aab269239da5d064 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:36.561327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:36.595779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:36.661253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917684c8-c734-4d76-b817-5d5c40cb9720 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:36.693569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:36.694157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:36.694436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:36.694730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:36.695445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=914b6fff20424d86aab269239da5d064, user.id=3473e14bb619457aa4423ab47ee0ee4a) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:36.695750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:36.697157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a325c88c-e233-4015-8c9c-e7a02dcdc06a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:36.702355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 560/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:36 2022] GET /identity/v3/role_assignments?user.id=3473e14bb619457aa4423ab47ee0ee4a&scope.project.id=914b6fff20424d86aab269239da5d064&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:38.595627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7c178-4671-4388-9257-f6a56f0429ce None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:38.596125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7c178-4671-4388-9257-f6a56f0429ce None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:38.596125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7c178-4671-4388-9257-f6a56f0429ce None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:38.597629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 587/1147] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:38.602724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:38.603143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:38.603307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:38.621755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:38.623000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:38.688543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 561/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:38.965013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7c178-4671-4388-9257-f6a56f0429ce None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:39.053145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:39.063589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7c178-4671-4388-9257-f6a56f0429ce None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:39.095957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:39.096566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:39.096879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:39.097864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:39.107550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:39.112123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:39.113797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:39.114746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 588/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:39.120032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:39.149320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:39.218747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f3ab5-aad7-4e2e-a837-578e3bf4e378 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:39.252288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:39.252884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:39.253242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:39.253521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:39.254178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:39.254480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:39.255884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:39.263731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 562/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:39.270350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:39.371750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858ed6a4-637e-46cc-a064-97cbe9d72a5b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:39.404686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:39.405299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:39.405579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:39.405853 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] PATH_INFO: `/v3/users/3473e14bb619457aa4423ab47ee0ee4a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:39.406972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] RBAC: Authorizing `identity:get_user(user_id=3473e14bb619457aa4423ab47ee0ee4a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:39.408396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:39.410778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 589/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:39 2022] GET /identity/v3/users/3473e14bb619457aa4423ab47ee0ee4a => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:39.416685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:39.505660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:39.514756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f1d39-6398-45bc-b0cf-397dc3d878d4 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:39.547646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad15337-4e01-4176-8714-bf190a9a9a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:39.548267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15337-4e01-4176-8714-bf190a9a9a1f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:39.548553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15337-4e01-4176-8714-bf190a9a9a1f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:39.548831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad15337-4e01-4176-8714-bf190a9a9a1f None admin] PATH_INFO: `/v3/projects/914b6fff20424d86aab269239da5d064` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:39.549933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15337-4e01-4176-8714-bf190a9a9a1f None admin] RBAC: Authorizing `identity:get_project(project_id=914b6fff20424d86aab269239da5d064)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:39.551533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad15337-4e01-4176-8714-bf190a9a9a1f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:39.553145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 563/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:39 2022] GET /identity/v3/projects/914b6fff20424d86aab269239da5d064 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:39.558964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:39.578141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:39.659561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741e6510-dbc4-4185-af2a-d7672898bf4f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:39.692924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3a604-e3ff-4416-af89-ec4f2257945b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:39.693573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a604-e3ff-4416-af89-ec4f2257945b None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:39.693858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a604-e3ff-4416-af89-ec4f2257945b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:39.694136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3a604-e3ff-4416-af89-ec4f2257945b None admin] PATH_INFO: `/v3/projects/914b6fff20424d86aab269239da5d064/users/3473e14bb619457aa4423ab47ee0ee4a/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:39.696051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a604-e3ff-4416-af89-ec4f2257945b None admin] RBAC: Authorizing `identity:create_grant(project_id=914b6fff20424d86aab269239da5d064, user_id=3473e14bb619457aa4423ab47ee0ee4a, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:39.697500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea3a604-e3ff-4416-af89-ec4f2257945b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:39.711035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 590/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:15:39 2022] PUT /identity/v3/projects/914b6fff20424d86aab269239da5d064/users/3473e14bb619457aa4423ab47ee0ee4a/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:15:41.582146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6886cf-c674-4781-b3ac-616eb34dfae3 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:41.582687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6886cf-c674-4781-b3ac-616eb34dfae3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:41.582687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6886cf-c674-4781-b3ac-616eb34dfae3 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:41.584071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 564/1154] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:41.589328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:41.589701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:41.589889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:41.607725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:41.608939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:41.674781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 591/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:41.949207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6886cf-c674-4781-b3ac-616eb34dfae3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:42.048987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6886cf-c674-4781-b3ac-616eb34dfae3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:42.082132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:42.082837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:42.083119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:42.083391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:42.093134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:42.098575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:42.099691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:42.100712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 565/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:42.105612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:42.115787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:42.203854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c409dbdf-62f7-47e0-a79d-2f9be4578e26 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:42.236503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:42.237095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:42.237889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:42.238355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:42.239213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:42.239519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:42.240880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:42.248645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 592/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:42.254519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:42.276905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:42.358132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022e1cb-ac7c-4a0d-94ec-7f4416b03ac1 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:42.390951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:42.391570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:42.391853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:42.392125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] PATH_INFO: `/v3/users/3473e14bb619457aa4423ab47ee0ee4a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:42.393230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] RBAC: Authorizing `identity:get_user(user_id=3473e14bb619457aa4423ab47ee0ee4a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:42.395487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:42.397072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 566/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:42 2022] GET /identity/v3/users/3473e14bb619457aa4423ab47ee0ee4a => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:42.403323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:42.470612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:42.501168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ef99fe-8ef2-4063-a824-be46731e68f6 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:42.538142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:42.538773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:42.539056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:42.539331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:42.605349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:42.606830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:42.671197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:42.703303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 593/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:42.709890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:42.797072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:42.817253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab5a90-f2cc-454e-8ae4-d9d9b6c61505 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:42.851632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eb884b-1231-4c49-aa8f-f2167c14d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:42.852256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb884b-1231-4c49-aa8f-f2167c14d267 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:42.852540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb884b-1231-4c49-aa8f-f2167c14d267 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:42.852815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eb884b-1231-4c49-aa8f-f2167c14d267 None admin] PATH_INFO: `/v3/projects/914b6fff20424d86aab269239da5d064` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:42.853924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb884b-1231-4c49-aa8f-f2167c14d267 None admin] RBAC: Authorizing `identity:get_project(project_id=914b6fff20424d86aab269239da5d064)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:42.855379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eb884b-1231-4c49-aa8f-f2167c14d267 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:42.857001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 567/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:42 2022] GET /identity/v3/projects/914b6fff20424d86aab269239da5d064 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:42.863322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:42.958944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f970d4-4046-47de-b653-21cfebc687b1 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:42.992021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:42.992614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:42.992901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:42.993179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:42.993904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=914b6fff20424d86aab269239da5d064, user.id=3473e14bb619457aa4423ab47ee0ee4a) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:42.994218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:42.995676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dd7a6-d09b-437a-9779-e3661c1a7d17 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:43.001214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 594/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:42 2022] GET /identity/v3/role_assignments?user.id=3473e14bb619457aa4423ab47ee0ee4a&scope.project.id=914b6fff20424d86aab269239da5d064&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:44.895010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77201-0f6a-43ea-84b2-7a80f5cfdd2f None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:44.895558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77201-0f6a-43ea-84b2-7a80f5cfdd2f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:44.895558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b77201-0f6a-43ea-84b2-7a80f5cfdd2f None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:44.896906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 568/1162] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:44.902162 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082000-7d91-4419-8238-7914949cec77 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:44.902546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082000-7d91-4419-8238-7914949cec77 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:44.902724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2082000-7d91-4419-8238-7914949cec77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:44.921426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c2082000-7d91-4419-8238-7914949cec77 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:44.922590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c2082000-7d91-4419-8238-7914949cec77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:44.947805 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:44.987201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 595/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:45.255039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77201-0f6a-43ea-84b2-7a80f5cfdd2f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:45.355041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b77201-0f6a-43ea-84b2-7a80f5cfdd2f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:45.387607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:45.388208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:45.388493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:45.388772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:45.413196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:45.455004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:45.457032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:45.551269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 569/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:45.557184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082000-7d91-4419-8238-7914949cec77 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:45.652750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2082000-7d91-4419-8238-7914949cec77 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:45.685332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:45.685954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:45.686239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:45.686516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:45.693005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:45.694437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-f67174d9-831f-4055-9bf1-bc78514e65e9 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:45.705417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:45.707137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:15:45.708287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 596/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:15:45 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:45.712912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:45.766298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:45.811402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7226b274-2a62-4672-a012-3b51f15b17f0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:45.844515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:45.845111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:45.845395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:45.845712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:45.846352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:45.847335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:45.848809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f69cc8-ade6-4f6a-90b1-b7bd9c84499a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:45.855702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 570/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Wed Aug 17 23:15:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:47.728133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be035d-b8ab-42bc-b101-50f6939c8c69 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:47.728627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be035d-b8ab-42bc-b101-50f6939c8c69 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:47.728627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be035d-b8ab-42bc-b101-50f6939c8c69 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:47.729932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 597/1167] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:47.735059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71594-12de-4b79-8b2a-60315cbb34a7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:47.735436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71594-12de-4b79-8b2a-60315cbb34a7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:47.735621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd71594-12de-4b79-8b2a-60315cbb34a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:47.753927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1bd71594-12de-4b79-8b2a-60315cbb34a7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:47.755136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1bd71594-12de-4b79-8b2a-60315cbb34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:47.820336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 571/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:48.093125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be035d-b8ab-42bc-b101-50f6939c8c69 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:48.118651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:48.193942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be035d-b8ab-42bc-b101-50f6939c8c69 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:48.225720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fb716a-29fe-4a8c-b7ae-c11061051f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:48.226314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb716a-29fe-4a8c-b7ae-c11061051f78 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:48.226593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb716a-29fe-4a8c-b7ae-c11061051f78 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:48.226893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fb716a-29fe-4a8c-b7ae-c11061051f78 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:48.227539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb716a-29fe-4a8c-b7ae-c11061051f78 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:48.228896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fb716a-29fe-4a8c-b7ae-c11061051f78 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:48.244802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 598/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Wed Aug 17 23:15:48 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:50.178338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57fc2f-c635-4be5-9aa8-d572b6c4a101 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:50.178925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57fc2f-c635-4be5-9aa8-d572b6c4a101 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:50.178925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57fc2f-c635-4be5-9aa8-d572b6c4a101 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:50.180286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 572/1170] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:50.185483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:50.185858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:50.186030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:50.204587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:50.206355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:50.271682 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 599/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:50.545796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57fc2f-c635-4be5-9aa8-d572b6c4a101 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:50.597227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:50.646516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57fc2f-c635-4be5-9aa8-d572b6c4a101 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:50.680862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd324c-9d0a-48d7-9ee8-6722ff54f1fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:50.681479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd324c-9d0a-48d7-9ee8-6722ff54f1fa None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:50.681765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd324c-9d0a-48d7-9ee8-6722ff54f1fa None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:50.682043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd324c-9d0a-48d7-9ee8-6722ff54f1fa None admin] PATH_INFO: `/v3/domains/5adcb8babf4f4226817d7edd97dc64cc` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:50.692150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd324c-9d0a-48d7-9ee8-6722ff54f1fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=5adcb8babf4f4226817d7edd97dc64cc)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:50.693579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd324c-9d0a-48d7-9ee8-6722ff54f1fa None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:50.695198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 573/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Aug 17 23:15:50 2022] GET /identity/v3/domains/5adcb8babf4f4226817d7edd97dc64cc => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:50.701029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:50.715525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:50.798429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231dde04-d4cb-4ace-a3c1-cb510ab6190b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:50.833254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d755e0fe-df7b-47c4-9395-c95caf308f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:50.833841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e0fe-df7b-47c4-9395-c95caf308f41 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:50.834122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e0fe-df7b-47c4-9395-c95caf308f41 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:50.834395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d755e0fe-df7b-47c4-9395-c95caf308f41 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:50.835054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e0fe-df7b-47c4-9395-c95caf308f41 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:50.836482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d755e0fe-df7b-47c4-9395-c95caf308f41 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:50.861929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 600/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:15:50 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:52.795027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209f4e1-1247-4b55-adc6-2af00afbd58d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:52.795629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209f4e1-1247-4b55-adc6-2af00afbd58d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:52.795629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7209f4e1-1247-4b55-adc6-2af00afbd58d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:52.796950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 574/1174] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:52.802335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22955430-7af8-436a-928f-93dde634f2dc None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:52.802772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22955430-7af8-436a-928f-93dde634f2dc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:52.803015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22955430-7af8-436a-928f-93dde634f2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:52.822014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-22955430-7af8-436a-928f-93dde634f2dc None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:52.823232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-22955430-7af8-436a-928f-93dde634f2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:52.882054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:52.890071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 601/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:53.165382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209f4e1-1247-4b55-adc6-2af00afbd58d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:53.264141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7209f4e1-1247-4b55-adc6-2af00afbd58d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:53.275402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:53.299774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e3995e-ec4a-46c7-b561-3f8b3ef15373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:53.300397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3995e-ec4a-46c7-b561-3f8b3ef15373 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:53.300673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3995e-ec4a-46c7-b561-3f8b3ef15373 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:53.300949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e3995e-ec4a-46c7-b561-3f8b3ef15373 None admin] PATH_INFO: `/v3/domains/5adcb8babf4f4226817d7edd97dc64cc` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:53.302045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3995e-ec4a-46c7-b561-3f8b3ef15373 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5adcb8babf4f4226817d7edd97dc64cc)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:53.303502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e3995e-ec4a-46c7-b561-3f8b3ef15373 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:53.305085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 575/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Wed Aug 17 23:15:53 2022] GET /identity/v3/domains/5adcb8babf4f4226817d7edd97dc64cc => generated 267 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:53.310810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22955430-7af8-436a-928f-93dde634f2dc None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:53.415360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22955430-7af8-436a-928f-93dde634f2dc None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:53.449027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b8cfa-6806-4cbf-83c8-38411363abcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:53.449564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b8cfa-6806-4cbf-83c8-38411363abcb None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:53.449843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b8cfa-6806-4cbf-83c8-38411363abcb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:53.450114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b8cfa-6806-4cbf-83c8-38411363abcb None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:53.450789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b8cfa-6806-4cbf-83c8-38411363abcb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:53.452217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b8cfa-6806-4cbf-83c8-38411363abcb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:53.472435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 602/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:15:53 2022] POST /identity/v3/users => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:15:55.386180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a762-dad3-434f-8e73-e663690982c1 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:55.386695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a762-dad3-434f-8e73-e663690982c1 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:55.386811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a762-dad3-434f-8e73-e663690982c1 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:55.388158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 576/1178] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:55.393555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:55.393937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:55.394118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:55.412606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:55.413791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:55.459803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:55.480236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 603/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:55.753185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312a762-dad3-434f-8e73-e663690982c1 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:55.854042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312a762-dad3-434f-8e73-e663690982c1 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:55.887139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:55.887750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:55.888027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:55.888296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:55.898722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:55.903582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:55.904759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:55.906020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 577/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:55.910869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:56.005848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500ff632-a87b-466c-ba7b-fe14da394f87 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:56.038470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:56.039096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:56.039383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:56.039660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:56.040322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:56.040625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:56.041999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:56.049780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 604/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:56.055592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:56.095350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:56.153950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d59b3-4435-436d-8307-ef70c279fb0a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:56.186713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:56.187348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:56.187630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:56.187903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] PATH_INFO: `/v3/users/1b3f00fead804203a279bb0567eabec7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:56.200824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] RBAC: Authorizing `identity:get_user(user_id=1b3f00fead804203a279bb0567eabec7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:56.202253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:56.203936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 578/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:56 2022] GET /identity/v3/users/1b3f00fead804203a279bb0567eabec7 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:56.210397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:56.254521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:56.308601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca41c1-3101-4da6-b95c-509b037531f3 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:56.340757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:56.341355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:56.341639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:56.341912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:56.409523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:56.410990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:56.452216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:56.508308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 605/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:15:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:15:56.514224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:56.607222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:56.613863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4537d4-5270-4dbc-97f9-757259cfd342 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:56.646649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a5398-4c7a-4fb1-9e77-aca50ff2bcaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:56.647297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5398-4c7a-4fb1-9e77-aca50ff2bcaa None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:56.647583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5398-4c7a-4fb1-9e77-aca50ff2bcaa None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:56.647862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a5398-4c7a-4fb1-9e77-aca50ff2bcaa None admin] PATH_INFO: `/v3/projects/0851fb4d089642e58cd6e803015dd5e6` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:56.648978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5398-4c7a-4fb1-9e77-aca50ff2bcaa None admin] RBAC: Authorizing `identity:get_project(project_id=0851fb4d089642e58cd6e803015dd5e6)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:56.650662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a5398-4c7a-4fb1-9e77-aca50ff2bcaa None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:56.652314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 579/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:56 2022] GET /identity/v3/projects/0851fb4d089642e58cd6e803015dd5e6 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:56.658311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:56.753027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9bc66-5044-471c-b01f-b002bd413f9f None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:56.785293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:56.785873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:56.786149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:56.786417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:56.787157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=0851fb4d089642e58cd6e803015dd5e6, user.id=1b3f00fead804203a279bb0567eabec7) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:56.787463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:56.788870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739f577-a0c6-4051-bdf6-c1241f052a07 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:56.793951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 606/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:15:56 2022] GET /identity/v3/role_assignments?user.id=1b3f00fead804203a279bb0567eabec7&scope.project.id=0851fb4d089642e58cd6e803015dd5e6&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:58.676878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841e0aa-32b2-489d-9878-e43ae719f4bb None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:58.677401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841e0aa-32b2-489d-9878-e43ae719f4bb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:58.677401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841e0aa-32b2-489d-9878-e43ae719f4bb None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:58.678720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 580/1186] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:15:58.684066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:58.684496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:58.684630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:58.702773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:15:58.703959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:15:58.706013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:58.769721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 607/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:15:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:15:59.036135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841e0aa-32b2-489d-9878-e43ae719f4bb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:59.135157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841e0aa-32b2-489d-9878-e43ae719f4bb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:59.168187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:59.168802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:59.169088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:59.169363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:59.179476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:15:59.184130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:15:59.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:15:59.186476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 581/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:15:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:15:59.191321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:59.286410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce02847-779f-42c1-95de-00e0f6b660fe None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:59.319500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:59.320094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:59.320376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:59.320652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:59.321307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:15:59.321608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:59.322999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:59.327764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:59.332314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 608/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:15:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:59.337736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:59.363345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:59.436869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90880ad8-7d41-455e-a89d-9e9a8125aa1a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:59.469795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:59.470413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:59.470724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:59.471003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] PATH_INFO: `/v3/users/1b3f00fead804203a279bb0567eabec7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:59.472812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] RBAC: Authorizing `identity:get_user(user_id=1b3f00fead804203a279bb0567eabec7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:59.474241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:59.475836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 582/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:15:59 2022] GET /identity/v3/users/1b3f00fead804203a279bb0567eabec7 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:59.481608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:59.578546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6d99ea-2804-4d0f-b1cb-a0661c8e2b59 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:59.610606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9edaf-48a2-4508-b78f-44e02340a09b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:59.611250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9edaf-48a2-4508-b78f-44e02340a09b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:59.611534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9edaf-48a2-4508-b78f-44e02340a09b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:59.612380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9edaf-48a2-4508-b78f-44e02340a09b None admin] PATH_INFO: `/v3/projects/0851fb4d089642e58cd6e803015dd5e6` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:59.613539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9edaf-48a2-4508-b78f-44e02340a09b None admin] RBAC: Authorizing `identity:get_project(project_id=0851fb4d089642e58cd6e803015dd5e6)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:59.615032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9edaf-48a2-4508-b78f-44e02340a09b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:59.616612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 609/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:15:59 2022] GET /identity/v3/projects/0851fb4d089642e58cd6e803015dd5e6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:15:59.622393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:15:59.711442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:15:59.720444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c401245-9118-476a-a68b-6fe44dc96ff2 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:15:59.754170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41932210-d20c-4628-ba7b-0b3f254afca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:15:59.754837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932210-d20c-4628-ba7b-0b3f254afca5 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:15:59.755122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932210-d20c-4628-ba7b-0b3f254afca5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:15:59.755402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41932210-d20c-4628-ba7b-0b3f254afca5 None admin] PATH_INFO: `/v3/projects/0851fb4d089642e58cd6e803015dd5e6/users/1b3f00fead804203a279bb0567eabec7/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:15:59.757283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41932210-d20c-4628-ba7b-0b3f254afca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0851fb4d089642e58cd6e803015dd5e6, user_id=1b3f00fead804203a279bb0567eabec7, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:15:59.758725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41932210-d20c-4628-ba7b-0b3f254afca5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:15:59.770974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 583/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:15:59 2022] PUT /identity/v3/projects/0851fb4d089642e58cd6e803015dd5e6/users/1b3f00fead804203a279bb0567eabec7/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:16:01.661915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff565c-047e-42ae-a15e-ab47a4ff2c77 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:01.662421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff565c-047e-42ae-a15e-ab47a4ff2c77 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:01.662421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff565c-047e-42ae-a15e-ab47a4ff2c77 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:01.663753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 610/1193] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:16:01.668754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19575173-b7ce-461e-806b-6959c812442e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:01.669121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19575173-b7ce-461e-806b-6959c812442e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:01.669307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19575173-b7ce-461e-806b-6959c812442e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:01.687655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-19575173-b7ce-461e-806b-6959c812442e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:16:01.688818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-19575173-b7ce-461e-806b-6959c812442e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:16:01.754404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 584/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:16:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:16:02.027632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff565c-047e-42ae-a15e-ab47a4ff2c77 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:02.094157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:02.128373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff565c-047e-42ae-a15e-ab47a4ff2c77 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:02.161279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:02.161895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:02.162180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:02.162454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:02.172200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:16:02.177420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:16:02.178516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:16:02.179629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 611/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:16:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:16:02.184645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19575173-b7ce-461e-806b-6959c812442e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:02.262149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:02.283186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19575173-b7ce-461e-806b-6959c812442e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:02.316404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:02.317007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:02.317291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:02.317565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:02.318229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:16:02.318535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:02.319932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:02.327641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 585/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:16:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:16:02.334119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:02.435435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28fec00-7f25-47cf-8082-9c08c21b46d0 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:02.461316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:02.469246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:02.469869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:02.470153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:02.470427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] PATH_INFO: `/v3/users/1b3f00fead804203a279bb0567eabec7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:02.472176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] RBAC: Authorizing `identity:get_user(user_id=1b3f00fead804203a279bb0567eabec7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:02.473602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:02.475203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 612/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Wed Aug 17 23:16:02 2022] GET /identity/v3/users/1b3f00fead804203a279bb0567eabec7 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:16:02.481130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:02.580692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0efc7b5-dc2b-463a-937f-8da3c2f2f58a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:02.614144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:02.614775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:02.615063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:02.615341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:02.629321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:02.681941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:02.683426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:02.778168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 586/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:16:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:16:02.784603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:02.880776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b6858-7f4e-4870-9fd2-69003700464b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:02.913155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97a9fbd-f322-46b9-8937-1f977ec17e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:02.913770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a9fbd-f322-46b9-8937-1f977ec17e27 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:02.914053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a9fbd-f322-46b9-8937-1f977ec17e27 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:02.914330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97a9fbd-f322-46b9-8937-1f977ec17e27 None admin] PATH_INFO: `/v3/projects/0851fb4d089642e58cd6e803015dd5e6` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:02.915451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a9fbd-f322-46b9-8937-1f977ec17e27 None admin] RBAC: Authorizing `identity:get_project(project_id=0851fb4d089642e58cd6e803015dd5e6)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:02.916870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97a9fbd-f322-46b9-8937-1f977ec17e27 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:02.918454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 613/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Wed Aug 17 23:16:02 2022] GET /identity/v3/projects/0851fb4d089642e58cd6e803015dd5e6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:16:02.925765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:02.970110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:03.029253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a52d5ab-210d-4c9d-8cc0-e3570f02721c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:03.063629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:03.064232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:03.064515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:03.064810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:03.066256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=0851fb4d089642e58cd6e803015dd5e6, user.id=1b3f00fead804203a279bb0567eabec7) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:16:03.066573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:03.068045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0369b4-17c9-45c6-911c-9004336103dd None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:03.073625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 587/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:16:02 2022] GET /identity/v3/role_assignments?user.id=1b3f00fead804203a279bb0567eabec7&scope.project.id=0851fb4d089642e58cd6e803015dd5e6&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:16:12.909598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=68 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:13.071135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=46 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:58.774068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d5f60-54e3-40ce-9eca-4bde11ba9061 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:58.774068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d5f60-54e3-40ce-9eca-4bde11ba9061 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:58.774068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d5f60-54e3-40ce-9eca-4bde11ba9061 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:58.774068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 614/1201] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:16:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:16:58.782739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:58.782739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:58.782739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:58.804044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:16:58.805384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:16:58.886765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 588/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:16:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:16:59.162536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d5f60-54e3-40ce-9eca-4bde11ba9061 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:59.298434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d5f60-54e3-40ce-9eca-4bde11ba9061 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:59.345096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:59.346345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:59.346759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:59.346982 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:59.358005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:59.359612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:16:59.377552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:16:59.379152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:16:59.380131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:16:59.380131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:16:59.380131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:16:59.380131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 615/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:16:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:16:59.385546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:59.506824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269ac70d-6032-408b-a4ab-0e9223b8b85d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:59.549051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:59.558133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:59.559142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:59.559625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:59.559946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:59.560551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:16:59.560860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:59.562294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1ce7e5-0586-4b29-83aa-c5a5125f6938 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:59.576310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 589/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:16:59.583998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:16:59.654465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:16:59.715515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0f16f-317b-4d9e-8ee0-6e2ca2bc0076 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:16:59.765952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a1543-b11a-406b-8310-f12e683ae5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:16:59.767195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1543-b11a-406b-8310-f12e683ae5ac None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:16:59.767702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1543-b11a-406b-8310-f12e683ae5ac None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:16:59.768218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a1543-b11a-406b-8310-f12e683ae5ac None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:16:59.768849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a1543-b11a-406b-8310-f12e683ae5ac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:16:59.772816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519a1543-b11a-406b-8310-f12e683ae5ac None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:16:59.802744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 616/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Wed Aug 17 23:16:59 2022] POST /identity/v3/users => generated 251 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:17:01.996790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2d4d-a442-4fdd-92f9-bcf1e15ac5bc None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:01.997332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2d4d-a442-4fdd-92f9-bcf1e15ac5bc None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:01.997332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be2d4d-a442-4fdd-92f9-bcf1e15ac5bc None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:02.002556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 590/1206] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:02.004870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:02.005382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:02.005487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:02.025034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:02.026797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:02.105887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 617/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:02.375566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2d4d-a442-4fdd-92f9-bcf1e15ac5bc None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:02.486312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be2d4d-a442-4fdd-92f9-bcf1e15ac5bc None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:02.527264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:02.527956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:02.528240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:02.528514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:02.540542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:17:02.545562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:02.546582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:02.547510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 591/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:17:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:02.552865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:02.601653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:02.676376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30a36ef-fdb2-4556-aa8a-5ec66fe040cb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:02.725291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:02.725952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:02.726235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:02.726600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:02.727306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:02.727613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:02.729144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:02.743940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 618/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:17:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:02.750265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:02.817651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:02.882837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655785c-52a9-423a-b1b9-c55f4b104f25 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:02.924244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:02.924903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:02.925173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:02.925452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:02.940351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:02.941924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:02.959662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:02.961476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:02.963432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:02.963432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:02.963432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:02.963432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 592/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:02.970093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:03.091188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:03.094193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe50d20-5bd2-4157-9f22-06de079d259e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:03.132487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:03.133132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:03.133434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:03.133755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:03.134404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:03.134773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:03.136208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:03.154878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 619/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:03.156787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:03.264621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24feeb3f-34f8-46c4-8c1f-d3977f761c8a None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:03.266321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:03.303273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:03.303931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:03.304216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:03.304570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] PATH_INFO: `/v3/users/placement` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:03.312395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:03.314411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:17:03.326666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:03.327870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:03.329158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:03.330815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 593/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:03.336544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:03.446841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec0de75-4bc3-438b-b312-a807f20ac0ae None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:03.491345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:03.492012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:03.492296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:03.492612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:03.493354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:03.493650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:03.495140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:03.515121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 620/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 17 23:17:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:03.519258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:03.637032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893ffde9-16da-4f56-85dd-c7a1634fd306 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:03.677699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:03.679048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:03.679048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:03.679048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:03.713858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:03.758558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:03.760160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:03.876713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 594/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:17:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:17:03.882587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:03.907743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:04.007658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74364c9-d0c7-4180-ab53-fd482ee7a0d2 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:04.046445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:04.047177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:04.048067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:04.049703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:04.058794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:04.060250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:04.077055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:04.078296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:04.079273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:04.079273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:04.079273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:04.079273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 621/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:04.084446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:04.154734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:04.197617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb04f9f-3c89-4f50-849d-5fa71769ee01 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:04.237110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:04.237735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:04.238015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:04.238287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:04.239016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:04.239323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:04.240704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:04.258808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 595/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:04.265350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:04.356439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:04.391841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e83cab-1017-437e-96a6-343121744a9e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:04.429230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:04.430006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:04.430357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:04.430716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:04.437588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:04.439387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:17:04.451300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:04.452285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:04.458686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 622/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:17:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:04.461455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:04.572975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e34b1-acc4-4a9a-9b69-ab51c72a1bcb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:04.600088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:04.614198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:04.614854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:04.615138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:04.615397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:04.616097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:04.616404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:04.617836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c668348-a64c-46d1-8d25-779d460d8822 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:04.631167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 596/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:17:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:04.637819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:04.752749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dd0f9f-eeb8-4245-820d-17dc86ea3356 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:04.783349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:04.792161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:04.792779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:04.793082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:04.793403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:04.794106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=ee2a386cf6c549c59051ee161f9a1d3c) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:04.794438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:04.795911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1d4bd-4003-44b6-8ebb-2830a80549c8 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:04.811000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 623/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:17:04 2022] GET /identity/v3/role_assignments?user.id=ee2a386cf6c549c59051ee161f9a1d3c&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:06.753039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c264-4451-48dd-bd6f-01f75d0ad25a None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:06.753704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c264-4451-48dd-bd6f-01f75d0ad25a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:06.753704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7c264-4451-48dd-bd6f-01f75d0ad25a None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:06.754915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 597/1220] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:06.760449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:06.760915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:06.761025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:06.782457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:06.783745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:06.853002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 624/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:07.150919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7c264-4451-48dd-bd6f-01f75d0ad25a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:07.262466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7c264-4451-48dd-bd6f-01f75d0ad25a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:07.305435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:07.306068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:07.306352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:07.306628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:07.317400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:17:07.322087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:07.323241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:07.324224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 598/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:17:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:07.330048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:07.444012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849c5b7-220a-4aba-8c51-1b244f164979 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:07.467771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:07.480639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:07.481263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:07.481522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:07.481793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:07.482455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] RBAC: Adding query filter params (name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:07.482903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:07.484279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:07.493316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 625/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:17:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:07.498882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:07.548581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:07.611217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd949f0-6f9e-4b41-ae64-2c1edb02c0cc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:07.653946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:07.654582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:07.654908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:07.655189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:07.665964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:07.667459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:07.685180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:07.686334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:07.687406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:07.687406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:07.687406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:07.687406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 599/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:07.692157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:07.796100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fdde5f-9887-4155-8d39-c605ea42de68 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:07.834933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:07.835549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:07.835837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:07.836117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:07.836773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:07.837081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:07.838453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:07.851123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 626/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:07.857342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:07.963668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:07.971951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5461b58-0671-4ac7-9500-aa9923e4c01c None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:08.007386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:08.008038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:08.008377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:08.008637 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] PATH_INFO: `/v3/users/placement` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:08.018611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:08.020454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:17:08.034291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:08.040318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:08.041325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 600/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:07 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:08.041961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:08.091104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:08.147020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa230c2-d084-4569-be01-e8806d9e8567 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:08.185372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:08.185987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:08.186268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:08.186540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:08.187315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:08.187623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:08.189212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:08.207078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 627/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 17 23:17:08 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:08.213871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:08.331822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388943db-f1e9-4520-8934-c21b48962063 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:08.370332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:08.370990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:08.371273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:08.371547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:08.384433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:08.386007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:08.401423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:08.402502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:08.403459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:08.403459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:08.403459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:08.403459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 601/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:08.409247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:08.521280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1acb09-88c9-4e25-9a30-f757e6aca68e None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:08.523682 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:08.560333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:08.561036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:08.561318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:08.561599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:08.562292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:08.562620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:08.565015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:08.579158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 628/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:08.585322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:08.596373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:08.712127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9ade2-86ea-4493-9f4f-a3ffd1a64073 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:08.747110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:08.747798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:08.748097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:08.748369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:08.755935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:08.757407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:17:08.770798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:08.771847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:08.778553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 602/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:17:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:08.779263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:08.892179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b29500-b9b3-4b12-bcab-6008d67affb4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:08.929281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:08.929969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:08.930183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:08.930456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:08.931184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:08.931491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:08.932938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55651f1-17e9-42d9-b104-647d5e0c7170 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:08.945373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 629/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:17:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:08.951609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:09.030207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:09.075468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bdc0a4-6a27-4865-8af2-3b01a6456f32 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:09.117081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755ae48e-dbf1-4a7c-b92b-8f6b65ed98e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:09.117732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ae48e-dbf1-4a7c-b92b-8f6b65ed98e7 None admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:09.118014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ae48e-dbf1-4a7c-b92b-8f6b65ed98e7 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:09.118286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755ae48e-dbf1-4a7c-b92b-8f6b65ed98e7 None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/ee2a386cf6c549c59051ee161f9a1d3c/roles/bbd2c6fd07b947d79a5748a7c3aff596` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:09.133641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ae48e-dbf1-4a7c-b92b-8f6b65ed98e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=ee2a386cf6c549c59051ee161f9a1d3c, role_id=bbd2c6fd07b947d79a5748a7c3aff596)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:09.135851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755ae48e-dbf1-4a7c-b92b-8f6b65ed98e7 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:09.151560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 603/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:17:08 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/ee2a386cf6c549c59051ee161f9a1d3c/roles/bbd2c6fd07b947d79a5748a7c3aff596 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:17:11.160249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d43cb-1685-42f9-9df0-0042d7a3ce54 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:11.160811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d43cb-1685-42f9-9df0-0042d7a3ce54 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:11.160811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62d43cb-1685-42f9-9df0-0042d7a3ce54 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:11.162117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 630/1233] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:11.167313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:11.167692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:11.167872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:11.187622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:11.189602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:11.257803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 604/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:11.536194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d43cb-1685-42f9-9df0-0042d7a3ce54 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:11.562632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:11.643050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62d43cb-1685-42f9-9df0-0042d7a3ce54 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:11.681528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:11.682438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:11.682747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:11.683096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:11.693946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:17:11.698551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:11.702860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:11.703779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 631/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Wed Aug 17 23:17:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:11.706057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:11.754212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:11.811271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6411-5edc-4085-897f-3dee6552a52c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:11.847087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:11.847628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:11.847909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:11.848185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:11.848854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] RBAC: Adding query filter params (name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:11.849173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:11.850528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:11.858672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 605/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Wed Aug 17 23:17:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:11.865244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:11.957186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:11.976913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac1f844-8657-48ec-acbe-26ffeda6ad24 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:12.014176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:12.014863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:12.015143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:12.015513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:12.027485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:12.029180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:12.045370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:12.046657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:12.048656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:12.048656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:12.048656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:12.048656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 632/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:12.054808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:12.168761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891b7e64-b587-4c99-9046-3adf54befc3d None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:12.178682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:12.209321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:12.210168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:12.210568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:12.211006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:12.211779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:12.212205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:12.213568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:12.225533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 606/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:12.231448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:12.337182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce11e326-3fcf-4d2a-970d-4e33e2f20fbb None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:12.374795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:12.375755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:12.376076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:12.376394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] PATH_INFO: `/v3/users/placement` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:12.379650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:12.385053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:12.386912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:17:12.400653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:12.401859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:12.403093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 633/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:12.408985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:12.519318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eedb4b-fac7-4e29-aa2b-2e413ac93259 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:12.557895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:12.558554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:12.558871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:12.559145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:12.559882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:12.560188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:12.561642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:12.580984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 607/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 17 23:17:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:12.587660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:12.705916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5360a4-b56c-4983-a661-54a880610ece None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:12.744899 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:12.745509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:12.745788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:12.746061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:12.815284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:12.823102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:12.824615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:12.940965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 634/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:17:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:17:12.947219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:12.979353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:13.065487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d2c423-72df-4de9-93ab-dc7f306bdccb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:13.104424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:13.105154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:13.105450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:13.105779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:13.116518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:13.117965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:13.133302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:13.134481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:13.135469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:13.135469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:13.135469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:13.135469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 608/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:13.140917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:13.246359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:13.253637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb26f5a-e62c-4990-9b64-c3a38b089dad None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:13.293568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:13.294196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:13.294480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:13.294788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:13.295439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:13.295744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:13.297116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:13.314532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 635/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:13.322161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:13.417030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:13.443065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecea94-0b63-4497-87f4-1284fdeffbe3 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:13.479490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:13.480130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:13.480414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:13.480691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:13.487780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:13.489252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:17:13.501030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:13.502392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:13.503453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 609/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:17:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:13.508350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:13.626430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386e799a-ba47-4d6a-a1c6-374800881a5b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:13.671484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:13.672120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:13.673071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:13.674081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:13.674832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:13.675144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:13.676855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9403710a-ffb6-44c7-af6c-b6de80284aa3 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:13.689994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 636/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:17:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:13.695989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:13.800659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1ceaa6-6974-4255-a3ae-03bfa4f920bf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:13.837720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:13.838330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:13.838612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:13.838914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:13.839645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] RBAC: Adding query filter params (role.id=bbd2c6fd07b947d79a5748a7c3aff596, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=ee2a386cf6c549c59051ee161f9a1d3c) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:13.839954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:13.841385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66148e03-c337-4afc-8de1-0847d191d7a2 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:13.848171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 610/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:17:13 2022] GET /identity/v3/role_assignments?user.id=ee2a386cf6c549c59051ee161f9a1d3c&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=bbd2c6fd07b947d79a5748a7c3aff596 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:15.866084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899a7b9-f988-466a-8f00-818f8696d26d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:15.866876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899a7b9-f988-466a-8f00-818f8696d26d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:15.866976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a899a7b9-f988-466a-8f00-818f8696d26d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:15.868680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 637/1247] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:15.875776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:15.876294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:15.876632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:15.883984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:15.899127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:15.901056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:15.980823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 611/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:16.281633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899a7b9-f988-466a-8f00-818f8696d26d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:16.301988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:16.404562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a899a7b9-f988-466a-8f00-818f8696d26d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:16.448146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:16.448781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:16.449065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:16.449338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:16.462426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:17:16.467783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:16.475002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:16.475909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 638/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:17:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:16.476619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:16.596566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d8e30-d2e2-4735-ab3d-53b1456c4c9e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:16.630924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:16.638228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:16.639137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:16.639602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:16.640064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:16.641683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:16.642183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:16.644067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:16.655322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 612/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:17:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:16.661550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:16.757103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:16.788026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dadd54-7da3-419f-ad5e-41d57ce5ffe7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:16.826596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:16.827251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:16.827535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:16.827815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:16.840360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:16.842036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:16.858127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:16.859342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:16.860801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:16.860801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:16.860801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:16.860801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 639/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:16.865852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:16.990146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bfc0db-71dd-46bd-86e5-f6945630db3b None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:17.030312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:17.030957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:17.031245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:17.031524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:17.032323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:17.032628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:17.034036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:17.049334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 613/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:17.055554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:17.167252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca06a8e-6c5c-4e7c-8057-dbe834b96892 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:17.197572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:17.206558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:17.207219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:17.207496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:17.207767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:17.215507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:17.216942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:17:17.229015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:17.230267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:17.231459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 640/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:17.236886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:17.299692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:17.351109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8114d629-7aa7-4643-93a6-ab745387fca0 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:17.390337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:17.391885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:17.392162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:17.392541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:17.393318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:17.393688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:17.395156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:17.414192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 614/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 17 23:17:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:17.420196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:17.532615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57156224-768c-4ef1-9ef1-022b4d8a38f7 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:17.572078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:17.572696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:17.572969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:17.573244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:17.632557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:17.645549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:17.647164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:17.762248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 641/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:17:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 17 23:17:17.769266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:17.891682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ef7a3-713c-4c99-9cf7-0cfa24d3d82f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:17.907491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:17.933029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:17.933726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:17.934012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:17.934412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:17.947723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:17.949373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:17.967339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:17.968517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:17.969904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:17.969904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:17.969904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:17.974527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 615/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:17.975032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:18.073068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:18.085700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d94b09-983c-42ca-ba95-9e4ba15ae7dd None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:18.121189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:18.121791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:18.122070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:18.122339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:18.123024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:18.123325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:18.124680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:18.135907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 642/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:18.142228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:18.247662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe3ac7-e160-459a-8ad4-b977051bd0cb None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:18.293233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db341-e8be-42cc-a794-848805baadcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:18.293878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db341-e8be-42cc-a794-848805baadcf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:18.294219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db341-e8be-42cc-a794-848805baadcf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:18.294526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616db341-e8be-42cc-a794-848805baadcf None admin] PATH_INFO: `/v3/projects/service` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:18.303733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616db341-e8be-42cc-a794-848805baadcf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:18.305270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616db341-e8be-42cc-a794-848805baadcf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-616db341-e8be-42cc-a794-848805baadcf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:17:18.317207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:18.318274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:18.319390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 616/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:17:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:18.324168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:18.433166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e4f71e-5fc0-4aba-9722-ffc5fbdc8dbc None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:18.469719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:18.470327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:18.470613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:18.470919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:18.471620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:18.471932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:18.473554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03351810-444d-4d3f-a027-dba025226c8c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:18.487778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 643/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:17:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:18.493997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db341-e8be-42cc-a794-848805baadcf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:18.523220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:18.612348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616db341-e8be-42cc-a794-848805baadcf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:18.651389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:18.652130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:18.652415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:18.652693 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:18.653429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=ee2a386cf6c549c59051ee161f9a1d3c) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:18.653739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:18.655326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95fc384-32b0-4239-8a83-c62bcf99e442 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:18.661879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 617/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:17:18 2022] GET /identity/v3/role_assignments?user.id=ee2a386cf6c549c59051ee161f9a1d3c&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=585c0d47a790421289bad938a0377b4f => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:20.574247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb62e8-fbd0-4f87-b878-c0c13e5fd1ac None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:20.574796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb62e8-fbd0-4f87-b878-c0c13e5fd1ac None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:20.574892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0deb62e8-fbd0-4f87-b878-c0c13e5fd1ac None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:20.576139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 644/1261] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:20.581776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:20.582196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:20.582328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:20.600675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:20.601859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:20.670661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 618/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:20.942439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb62e8-fbd0-4f87-b878-c0c13e5fd1ac None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:20.953066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:21.042357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0deb62e8-fbd0-4f87-b878-c0c13e5fd1ac None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:21.074935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:21.075548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:21.075826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:21.076098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:21.085925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:17:21.090469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:21.091602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:21.092795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 645/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:21.098315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:21.116988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:21.195614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91b0920-b7e6-4987-a1e7-e46dbab19243 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:21.228734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:21.229335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:21.229622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:21.229898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:21.230562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:21.230895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:21.232260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:21.240611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 619/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:17:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:21.246259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:21.312482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:21.345316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683bacdd-d780-4e41-8d02-a8f95e5db363 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:21.378065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:21.378689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:21.378999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:21.379276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:21.388863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:21.390316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:21.405051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:21.406140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:21.407901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:21.407901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:21.407901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:21.407901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 646/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:21.412781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:21.491136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:21.509520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ad92c-acb0-49d4-ab67-ce2d8b5bbd38 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:21.546310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:21.546934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:21.547263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:21.547542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:21.548183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:21.548488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:21.549853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:21.561128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 620/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:21.566852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:21.677994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5942bf0-9257-4735-8cab-50c288748576 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:21.706534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:21.721127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:21.721749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:21.722030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:21.722300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:21.729427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:21.730892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:17:21.742394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:21.743528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:21.744497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 647/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:21.749398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:21.846941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19edc84a-23b3-47d7-a3f3-d01ee1caf008 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:21.881604 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:21.882323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:21.882764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:21.883211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:21.883948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:21.884258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:21.885677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:21.895120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:21.903818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 621/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 17 23:17:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:21.909653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:22.014390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a4c77-7dee-456a-85cb-d1bd0aa730fa None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:22.051398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:22.052025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:22.052307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:22.052580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:22.065472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:22.067505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:22.082546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:22.084763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:22.085860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:22.085860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:22.085860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:22.085860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 648/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:22.089866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:22.205550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdc474c-a116-4c53-9c9a-926fbdb5f9dc None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:22.243724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:22.244334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:22.244616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:22.244895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:22.245536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:22.245867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:22.247514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:22.262216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 622/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:22.270333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:22.307487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:22.388681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcbbc08-80e8-459e-9bb3-505812e05658 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:22.426836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:22.427470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:22.427748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:22.428019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:22.437457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:22.440078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:17:22.452100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:22.453169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:22.454424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 649/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:22.459739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:22.528572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:22.582115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2949e15-bb5f-43ff-b961-098f1f40f391 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:22.623892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:22.624712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:22.624991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:22.625389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:22.626514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:22.626880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:22.628502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6de194-4078-4888-9edf-08522401a716 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:22.645928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 623/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:22.653836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:22.755110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:22.764098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ba52a7-eba6-4a34-be45-d7533f26a7c4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:22.798351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42811566-793b-409d-94dc-a97453d4b19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:22.799030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42811566-793b-409d-94dc-a97453d4b19b None admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:22.799323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42811566-793b-409d-94dc-a97453d4b19b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:22.799599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42811566-793b-409d-94dc-a97453d4b19b None admin] PATH_INFO: `/v3/projects/aa5944918b1c42129bedec2198bb7391/users/ee2a386cf6c549c59051ee161f9a1d3c/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:22.801475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42811566-793b-409d-94dc-a97453d4b19b None admin] RBAC: Authorizing `identity:create_grant(project_id=aa5944918b1c42129bedec2198bb7391, user_id=ee2a386cf6c549c59051ee161f9a1d3c, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:22.802945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42811566-793b-409d-94dc-a97453d4b19b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:22.815728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 650/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Wed Aug 17 23:17:22 2022] PUT /identity/v3/projects/aa5944918b1c42129bedec2198bb7391/users/ee2a386cf6c549c59051ee161f9a1d3c/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:17:24.727435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf7e3-e1b3-4198-8975-5761101a0954 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:24.728030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf7e3-e1b3-4198-8975-5761101a0954 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:24.728030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493bf7e3-e1b3-4198-8975-5761101a0954 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:24.729247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 624/1274] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:24.734521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:24.735228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:24.735228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:24.753277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:24.754464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:24.819206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 651/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:25.095699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf7e3-e1b3-4198-8975-5761101a0954 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:25.193882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493bf7e3-e1b3-4198-8975-5761101a0954 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:25.211043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:25.227533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:25.228149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:25.228432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:25.228706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:25.239052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 17 23:17:25.243661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:25.244821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:25.246143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 625/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Wed Aug 17 23:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:25.251339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:25.332510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:25.350697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9f16dd-323a-4667-8296-507b5aea85f0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:25.383946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:25.384544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:25.384827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:25.385104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:25.385765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:25.386068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:25.387518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:25.395194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 652/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Wed Aug 17 23:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:25.401222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:25.499076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056878cc-fb03-44c1-ab89-5d7edcee6119 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:25.532392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:25.533005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:25.533292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:25.533560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:25.543200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:25.544633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:25.559223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:25.560482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:25.561676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:25.561676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:25.561676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:25.561676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 626/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:25.566283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:25.682370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287d533-b12f-435d-ad99-36bcfd25d9e4 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:25.720051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f0054-880d-4089-86b9-c980908df2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:25.720654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f0054-880d-4089-86b9-c980908df2be None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:25.720937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f0054-880d-4089-86b9-c980908df2be None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:25.721209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633f0054-880d-4089-86b9-c980908df2be None admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:25.721847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f0054-880d-4089-86b9-c980908df2be None admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:25.722147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f0054-880d-4089-86b9-c980908df2be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:25.723523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633f0054-880d-4089-86b9-c980908df2be None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:25.735280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 653/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:25.741023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:25.770889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:25.838884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49caded0-867c-4b5b-b78d-cee4d072febf None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:25.871373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:25.871982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:25.872270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:25.872544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:25.879829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:25.881258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 17 23:17:25.892618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:25.893757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:25.894809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 627/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:25.899410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f0054-880d-4089-86b9-c980908df2be None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:25.903661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:25.997052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633f0054-880d-4089-86b9-c980908df2be None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:26.029759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:26.030355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:26.030637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:26.030940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:26.031727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:26.032033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:26.033476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:26.050788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 654/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Wed Aug 17 23:17:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:26.056493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:26.147238 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:26.157324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e90fa4-10f8-4e42-b667-5cb542461b5f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:26.190165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:26.190780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:26.191065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:26.191339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:26.255976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:26.257354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:26.343586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:26.354658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 628/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Wed Aug 17 23:17:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 17 23:17:26.361376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:26.419910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:26.457790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a167ef2e-ed83-4e24-b755-65c63c7c473d None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:26.490883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:26.491500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:26.491783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:26.492058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:26.501657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:26.503125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 17 23:17:26.517027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:26.518151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 17 23:17:26.519143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 17 23:17:26.519143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 17 23:17:26.519143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:26.519143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 655/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 17 23:17:26.523699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:26.622290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f97c36-4bee-408b-a1ec-2eeb70cbbb6e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:26.657235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:26.657952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:26.658232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:26.658504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:26.659171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:26.659473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:26.660821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:26.671522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 629/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Wed Aug 17 23:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:26.677131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:26.777165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e26fa-b45b-4445-be7a-9600f4e61daa None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:26.790365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:26.810485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:26.811124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:26.811406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:26.811676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] PATH_INFO: `/v3/projects/service` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:26.818942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:26.820370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 17 23:17:26.831330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:26.832411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: ERROR keystone.server.flask.application Aug 17 23:17:26.833468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 656/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Wed Aug 17 23:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:26.838358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:26.887536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:26.936338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9dcc7-3407-4764-b65f-8b674da8a014 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:26.968514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:26.969727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:26.970019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:26.970296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:26.971009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:26.971316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:26.972725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b2e242-36b0-4787-b4fb-259e453c80d5 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:26.984117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 630/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Wed Aug 17 23:17:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:26.990356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:27.088192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288e8b9f-6732-4622-bb43-0dec76e2c60b None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:27.120073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:27.120663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:27.120942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:27.121217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:27.121930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] RBAC: Adding query filter params (role.id=585c0d47a790421289bad938a0377b4f, scope.project.id=aa5944918b1c42129bedec2198bb7391, user.id=ee2a386cf6c549c59051ee161f9a1d3c) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:27.122237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:27.123676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c47f5-d638-46af-a289-f434fd1f1e4b None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:27.129964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 657/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Wed Aug 17 23:17:26 2022] GET /identity/v3/role_assignments?user.id=ee2a386cf6c549c59051ee161f9a1d3c&scope.project.id=aa5944918b1c42129bedec2198bb7391&role.id=585c0d47a790421289bad938a0377b4f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:29.016040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b467673-cc65-4199-acad-fff71ddccf4d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:29.016608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b467673-cc65-4199-acad-fff71ddccf4d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:29.016850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b467673-cc65-4199-acad-fff71ddccf4d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:29.021486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 631/1288] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:29.023981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:29.024381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:29.024537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:29.044065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:29.045238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:29.074671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:29.110895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 658/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:29.377538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b467673-cc65-4199-acad-fff71ddccf4d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:29.477125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b467673-cc65-4199-acad-fff71ddccf4d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:29.487662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:29.511222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:29.511845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:29.512129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:29.512405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] PATH_INFO: `/v3/services/placement` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:29.512985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:29.514342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:29.522940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:29.524833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:29.526788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:29.529247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 632/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:17:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:29.530380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:29.628814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74745b76-81bb-4013-8aa4-b2fa01b1820c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:29.666573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:29.667326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:29.667578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:29.667924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:29.668692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] RBAC: Adding query filter params (name=placement) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:29.669037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:29.670876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6822df0-132d-417a-8a02-866503f89baf None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:29.676896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 659/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 17 23:17:29 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:29.683480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:29.782612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3799a0ad-9655-4515-bdb0-4987bcc6e54f None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:29.814568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:29.815189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:29.815473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:29.815746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] PATH_INFO: `/v3/services` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:29.816369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] RBAC: Adding query filter params (type=placement) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:29.816669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:29.818028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620acb0c-8397-4587-85af-3f56753094b3 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:29.822337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 633/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 17 23:17:29 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:31.753745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bab5d-f150-4241-aacc-935bd8fcfa1e None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:31.754244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bab5d-f150-4241-aacc-935bd8fcfa1e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:31.754244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381bab5d-f150-4241-aacc-935bd8fcfa1e None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:31.755574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 660/1293] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:31.760531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800e92-f1aa-4689-be61-a030e8134389 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:31.760965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800e92-f1aa-4689-be61-a030e8134389 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:31.761067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd800e92-f1aa-4689-be61-a030e8134389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:31.779659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-fd800e92-f1aa-4689-be61-a030e8134389 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:31.780839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fd800e92-f1aa-4689-be61-a030e8134389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:31.809317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:31.846630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 634/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:32.111351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bab5d-f150-4241-aacc-935bd8fcfa1e None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:32.141923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:32.210967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381bab5d-f150-4241-aacc-935bd8fcfa1e None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:32.243073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecfdfe3-5c5f-480b-9ffe-cc165115cf15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:32.243664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfdfe3-5c5f-480b-9ffe-cc165115cf15 None admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:32.243943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfdfe3-5c5f-480b-9ffe-cc165115cf15 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:32.244216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecfdfe3-5c5f-480b-9ffe-cc165115cf15 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:32.244842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfdfe3-5c5f-480b-9ffe-cc165115cf15 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:32.246203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecfdfe3-5c5f-480b-9ffe-cc165115cf15 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:32.260246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 661/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Wed Aug 17 23:17:32 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:17:34.170480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8952d7-6878-4a4a-b6b8-3834da524fc8 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:34.171072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8952d7-6878-4a4a-b6b8-3834da524fc8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:34.171072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8952d7-6878-4a4a-b6b8-3834da524fc8 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:34.173155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 635/1296] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:34.178441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:34.178893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:34.179032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:34.197235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:34.198416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:34.267535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 662/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:34 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 17 23:17:34.541653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8952d7-6878-4a4a-b6b8-3834da524fc8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:34.641610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8952d7-6878-4a4a-b6b8-3834da524fc8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:34.674680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:34.675333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:34.675619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:34.675893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] PATH_INFO: `/v3/services/placement` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:34.676479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:34.677853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:34.686310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:34.688001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:34.688870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 636/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:17:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:34.694082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:34.712290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:34.796005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd24a6-4c28-4b78-aa2c-b8af056bce22 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:34.834553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:34.835181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:34.835468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:34.835747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:34.836377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] RBAC: Adding query filter params (name=placement) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:34.836683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:34.838052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:34.843020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 663/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 17 23:17:34 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:34.849201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:34.881159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:34.950595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43f6bec-97e6-4719-a54f-e614f1995164 None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:34.983032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:34.983620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:34.983900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:34.984172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:34.985701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] RBAC: Adding query filter params (interface=public, service_id=40bbac22e95e4a20a3cad5a2e4cd00b5, region_id=RegionOne) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:34.986007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:34.987406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f76940-9776-4bbf-8f48-f19487a62ad6 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:34.993422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 637/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Wed Aug 17 23:17:34 2022] GET /identity/v3/endpoints?service_id=40bbac22e95e4a20a3cad5a2e4cd00b5&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:17:35.000929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:35.079700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:35.097127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087eeae4-15d6-42fd-adef-e13e5852d202 None admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:35.129360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bef9a6-a33a-439f-ba21-cf0a2c8fb53c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:35.129951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bef9a6-a33a-439f-ba21-cf0a2c8fb53c None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:35.130233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bef9a6-a33a-439f-ba21-cf0a2c8fb53c None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:35.130509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bef9a6-a33a-439f-ba21-cf0a2c8fb53c None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:35.131137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bef9a6-a33a-439f-ba21-cf0a2c8fb53c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:35.132500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bef9a6-a33a-439f-ba21-cf0a2c8fb53c None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:35.138986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 664/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Wed Aug 17 23:17:34 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:17:37.025402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecadcb7-0cb0-4176-9acd-2ddeeeaaa69d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:37.026228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecadcb7-0cb0-4176-9acd-2ddeeeaaa69d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:37.026228 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecadcb7-0cb0-4176-9acd-2ddeeeaaa69d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:37.027583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 638/1302] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:17:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:17:37.033433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:37.033851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:37.033968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:37.052214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:17:37.053386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:17:37.118510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 665/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:17:37 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 17 23:17:37.385105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecadcb7-0cb0-4176-9acd-2ddeeeaaa69d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:37.479757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:37.486866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecadcb7-0cb0-4176-9acd-2ddeeeaaa69d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:37.520688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:37.521309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:37.521595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:37.521869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] PATH_INFO: `/v3/services/placement` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:37.522450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:37.523846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 17 23:17:37.532531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 17 23:17:37.533666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.get_or_create( Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application with Lock( Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self._enter() Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application return self.creator() Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application created_value = creator( Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: ERROR keystone.server.flask.application Aug 17 23:17:37.534628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 639/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Wed Aug 17 23:17:37 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 17 23:17:37.539830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:37.613548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:37.638837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9de6aad-eb45-42b1-900b-6497314ffc02 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:37.673824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:37.674433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:37.674749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:37.675096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] PATH_INFO: `/v3/services` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:37.675735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:17:37.676043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:37.677412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22abc012-859f-4c27-8bf8-f541b7b7b4bf None admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:37.682346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 666/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Wed Aug 17 23:17:37 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:17:37.688689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:17:37.787459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d22335b-9030-4177-8d91-93f3fa6cc40e None admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:17:37.820332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3ac40e-4b7a-4536-af98-4d4c17cf3119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:17:37.820859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ac40e-4b7a-4536-af98-4d4c17cf3119 None admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:17:37.821143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ac40e-4b7a-4536-af98-4d4c17cf3119 None admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:17:37.821419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3ac40e-4b7a-4536-af98-4d4c17cf3119 None admin] PATH_INFO: `/v3/endpoints` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:17:37.822082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ac40e-4b7a-4536-af98-4d4c17cf3119 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:17:37.823474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3ac40e-4b7a-4536-af98-4d4c17cf3119 None admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:17:37.842593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 640/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:17:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:17:47.679685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=30 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:17:47.838493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:41.318418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10c6a-f907-422a-a5a4-05fae1d8b071 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:41.318997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10c6a-f907-422a-a5a4-05fae1d8b071 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:41.319081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd10c6a-f907-422a-a5a4-05fae1d8b071 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:41.325840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1daf2-3101-43a7-896d-594b7ffc1023 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:41.326316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1daf2-3101-43a7-896d-594b7ffc1023 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:41.326398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1daf2-3101-43a7-896d-594b7ffc1023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:41.331925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 667/1307] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:41 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:41.414314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-71c1daf2-3101-43a7-896d-594b7ffc1023 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:41.417854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-71c1daf2-3101-43a7-896d-594b7ffc1023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:41.616098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 641/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:41.909290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc871ed6-9ca2-4c18-bf69-dd6005608b5f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:41.909776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc871ed6-9ca2-4c18-bf69-dd6005608b5f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:41.910158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc871ed6-9ca2-4c18-bf69-dd6005608b5f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:41.911662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 668/1309] 10.222.0.39 () {54 vars in 965 bytes} [Wed Aug 17 23:18:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:41.917734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921b266-aa91-4ebb-9240-db1555e7223d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:41.918137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921b266-aa91-4ebb-9240-db1555e7223d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:41.918523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921b266-aa91-4ebb-9240-db1555e7223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:42.007562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3921b266-aa91-4ebb-9240-db1555e7223d None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:42.008996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3921b266-aa91-4ebb-9240-db1555e7223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:42.033435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:42.099309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 642/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Aug 17 23:18:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:42.108538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc871ed6-9ca2-4c18-bf69-dd6005608b5f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:18:42.110643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cc871ed6-9ca2-4c18-bf69-dd6005608b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:42.229228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc871ed6-9ca2-4c18-bf69-dd6005608b5f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:18:42.312670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:18:42.313436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:42.313903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:42.314200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:42.316420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:42.378628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:42.437517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:18:42.439190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca77a90-b383-42f4-84d3-b6ca78cfac4c service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:18:42.459630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 669/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:18:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:18:44.718856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcedf4-32fa-4c0c-b598-db6a25f551ef None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:44.719321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcedf4-32fa-4c0c-b598-db6a25f551ef None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:44.719547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbcedf4-32fa-4c0c-b598-db6a25f551ef None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:44.720963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 643/1312] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:44.725960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42e02-3f4c-4ca2-a5b4-085b12c100e9 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:44.726395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42e02-3f4c-4ca2-a5b4-085b12c100e9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:44.726500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d42e02-3f4c-4ca2-a5b4-085b12c100e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:44.810270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-68d42e02-3f4c-4ca2-a5b4-085b12c100e9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:44.812050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-68d42e02-3f4c-4ca2-a5b4-085b12c100e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:44.920185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 670/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:45.206110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcedf4-32fa-4c0c-b598-db6a25f551ef None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:18:45.207705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2cbcedf4-32fa-4c0c-b598-db6a25f551ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:45.311842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbcedf4-32fa-4c0c-b598-db6a25f551ef None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:18:45.380960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:45.383568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:18:45.384435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:45.384915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:45.385403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:45.387095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:45.494592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:18:45.496136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a10909a-380a-43c6-94e9-8e946de10a30 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:18:45.515636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 644/1314] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:18:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:18:47.746263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13f63-a7df-4369-be81-514e2cadae5e None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:47.746820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13f63-a7df-4369-be81-514e2cadae5e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:47.746942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf13f63-a7df-4369-be81-514e2cadae5e None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:47.748191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 671/1315] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:47.754139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1670-3e4c-4236-ba18-7e5f5c100061 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:47.754556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1670-3e4c-4236-ba18-7e5f5c100061 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:47.754693 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6a1670-3e4c-4236-ba18-7e5f5c100061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:47.820105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7f6a1670-3e4c-4236-ba18-7e5f5c100061 None None] MFA Rules not processed for user `8bcfcb5c3316435d8f5f66c269154e75`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:47.821310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7f6a1670-3e4c-4236-ba18-7e5f5c100061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:47.871759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:47.917286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 645/1316] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:47 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:48.204123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf13f63-a7df-4369-be81-514e2cadae5e None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:18:48.205668 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fdf13f63-a7df-4369-be81-514e2cadae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:48.215513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:48.310240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf13f63-a7df-4369-be81-514e2cadae5e None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:18:48.383531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:18:48.384147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:48.384431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:48.384703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:48.386296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:48.446929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:48.493783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:18:48.495198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f846f14-2ef6-4b07-ab02-92edae2e9421 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:18:48.513049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 672/1317] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:18:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:18:51.004803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e854a-72ea-4111-830c-5aa5adfac7ee None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:51.005280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e854a-72ea-4111-830c-5aa5adfac7ee None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:51.005403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041e854a-72ea-4111-830c-5aa5adfac7ee None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:51.006752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 646/1318] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:51.011867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf162-74e4-4206-b2eb-7e38c322924b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:51.012291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf162-74e4-4206-b2eb-7e38c322924b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:51.012424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3baf162-74e4-4206-b2eb-7e38c322924b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:51.077703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e3baf162-74e4-4206-b2eb-7e38c322924b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:51.078917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e3baf162-74e4-4206-b2eb-7e38c322924b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:51.174381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 673/1319] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:51.459592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e854a-72ea-4111-830c-5aa5adfac7ee None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:18:51.461129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-041e854a-72ea-4111-830c-5aa5adfac7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:51.563430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041e854a-72ea-4111-830c-5aa5adfac7ee None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:18:51.635393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:18:51.635994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:51.636273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:51.636542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:51.638118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:51.648791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:51.747362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:18:51.749593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47195ca3-e0be-4fb2-bc78-2665cce41510 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:18:51.767924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 647/1320] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:18:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:18:54.338670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56be8b-f298-462c-9b4c-bf310db6c330 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:54.339200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56be8b-f298-462c-9b4c-bf310db6c330 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:54.339291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af56be8b-f298-462c-9b4c-bf310db6c330 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:54.340634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 674/1321] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:54.347052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1af81-bbf9-48e2-851f-c7aef807cb51 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:54.347504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1af81-bbf9-48e2-851f-c7aef807cb51 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:54.347736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1af81-bbf9-48e2-851f-c7aef807cb51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:54.414873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b7b1af81-bbf9-48e2-851f-c7aef807cb51 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:54.416087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b7b1af81-bbf9-48e2-851f-c7aef807cb51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:54.473411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:54.516350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 648/1322] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:54.805295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56be8b-f298-462c-9b4c-bf310db6c330 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:18:54.806881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-af56be8b-f298-462c-9b4c-bf310db6c330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:54.826616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:54.914210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af56be8b-f298-462c-9b4c-bf310db6c330 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:18:54.990360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:18:54.990903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:54.991193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:54.991469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:54.993082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:55.067440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:55.105940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:18:55.107427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81642e5f-e18d-4f32-911f-07c1faed4c77 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:18:55.126865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 675/1323] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:18:57.114607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac6ae-cb14-42ac-8bdc-1803d234470c None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:57.115187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac6ae-cb14-42ac-8bdc-1803d234470c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:57.115187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ac6ae-cb14-42ac-8bdc-1803d234470c None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:57.116434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 649/1324] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:57.121676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0536-aba2-4923-b59c-c5493ebc1a50 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:57.122156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0536-aba2-4923-b59c-c5493ebc1a50 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:57.122244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0536-aba2-4923-b59c-c5493ebc1a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:57.190404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-952a0536-aba2-4923-b59c-c5493ebc1a50 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:57.191651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-952a0536-aba2-4923-b59c-c5493ebc1a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:57.297696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 676/1325] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:18:57.577658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ac6ae-cb14-42ac-8bdc-1803d234470c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:18:57.579289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fc7ac6ae-cb14-42ac-8bdc-1803d234470c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:57.685288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ac6ae-cb14-42ac-8bdc-1803d234470c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:18:57.767705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:18:57.768318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:57.768599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:57.768874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:57.770486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:18:57.787650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:18:57.882019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:18:57.883509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0875c0c-b2df-4f04-a375-3b224da0a3f5 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:18:57.902162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 650/1326] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:18:59.897275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73d875-75d7-42ef-8b34-f75435e4b767 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:59.897763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73d875-75d7-42ef-8b34-f75435e4b767 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:59.897864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73d875-75d7-42ef-8b34-f75435e4b767 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:59.899212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 677/1327] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:18:59.905280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7c969-adfd-488b-b0fd-c53f7f178764 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:18:59.905734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7c969-adfd-488b-b0fd-c53f7f178764 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:18:59.905860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c7c969-adfd-488b-b0fd-c53f7f178764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:18:59.978230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b1c7c969-adfd-488b-b0fd-c53f7f178764 None None] MFA Rules not processed for user `8bcfcb5c3316435d8f5f66c269154e75`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:18:59.979469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b1c7c969-adfd-488b-b0fd-c53f7f178764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:00.042832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:00.075293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 651/1328] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:18:59 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:00.363128 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73d875-75d7-42ef-8b34-f75435e4b767 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:00.364735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5d73d875-75d7-42ef-8b34-f75435e4b767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:00.400194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:00.476517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73d875-75d7-42ef-8b34-f75435e4b767 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:00.550831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:00.551441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:00.551731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:00.552009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:00.553633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:00.631116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:00.663563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:00.665002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75eb2438-227f-4796-be4f-c813a640e912 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:00.686871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 678/1329] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:00 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:19:02.894340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bdc36-2682-49b6-97cd-2b7fdf535d48 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:02.894906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bdc36-2682-49b6-97cd-2b7fdf535d48 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:02.894906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3bdc36-2682-49b6-97cd-2b7fdf535d48 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:02.896272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 652/1330] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:02.901932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef739-ff33-4745-aa86-f972a374ff75 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:02.902370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef739-ff33-4745-aa86-f972a374ff75 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:02.902477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fef739-ff33-4745-aa86-f972a374ff75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:02.968646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-58fef739-ff33-4745-aa86-f972a374ff75 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:02.969930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-58fef739-ff33-4745-aa86-f972a374ff75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:03.068885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 679/1331] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:03.352726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bdc36-2682-49b6-97cd-2b7fdf535d48 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:03.354300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5a3bdc36-2682-49b6-97cd-2b7fdf535d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:03.455490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3bdc36-2682-49b6-97cd-2b7fdf535d48 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:03.528604 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:03.529210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:03.529988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:03.530262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:03.531943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:03.558538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:03.640131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:03.641572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acbd942-8cbc-480a-aee2-447640b7552c service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:03.660402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 653/1332] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:05.602987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ccbd-eb4c-4f2d-9f7b-a6b62687c339 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:05.603517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ccbd-eb4c-4f2d-9f7b-a6b62687c339 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:05.603517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8ccbd-eb4c-4f2d-9f7b-a6b62687c339 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:05.604804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 680/1333] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:05.610727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd217e-56aa-49a7-8310-f396ccd7da4a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:05.611158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd217e-56aa-49a7-8310-f396ccd7da4a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:05.611295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fd217e-56aa-49a7-8310-f396ccd7da4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:05.677912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-11fd217e-56aa-49a7-8310-f396ccd7da4a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:05.679150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-11fd217e-56aa-49a7-8310-f396ccd7da4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:05.752100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:05.774438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 654/1334] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:19:06.069264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ccbd-eb4c-4f2d-9f7b-a6b62687c339 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:06.070830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-21c8ccbd-eb4c-4f2d-9f7b-a6b62687c339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:06.111665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:06.175267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8ccbd-eb4c-4f2d-9f7b-a6b62687c339 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:06.246148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:06.246819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:06.247104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:06.247381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:06.249605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:06.331421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:06.356712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:06.359027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc5a8e-45e2-4421-b74a-d0a997089485 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:06.377912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 681/1335] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:08.652176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b303b-12e1-4a3d-9879-b76ebfd48ec6 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:08.652713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b303b-12e1-4a3d-9879-b76ebfd48ec6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:08.652810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24b303b-12e1-4a3d-9879-b76ebfd48ec6 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:08.654101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 655/1336] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:08.660037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36a3af-da88-44c5-9aa2-a22c2acecaf4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:08.660462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36a3af-da88-44c5-9aa2-a22c2acecaf4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:08.660586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36a3af-da88-44c5-9aa2-a22c2acecaf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:08.725953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4f36a3af-da88-44c5-9aa2-a22c2acecaf4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:08.727197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4f36a3af-da88-44c5-9aa2-a22c2acecaf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:08.822095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 682/1337] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:09.111597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b303b-12e1-4a3d-9879-b76ebfd48ec6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:09.113155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c24b303b-12e1-4a3d-9879-b76ebfd48ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:09.218204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24b303b-12e1-4a3d-9879-b76ebfd48ec6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:09.291786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:09.292399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:09.292684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:09.292959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:09.294562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:09.330840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:09.406815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:09.408269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f03866-67cc-4032-9009-649800456d52 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:09.426621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 656/1338] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:09 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:13.265321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560f5c-a1b6-43ba-b657-8c59077e3d87 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:13.265804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560f5c-a1b6-43ba-b657-8c59077e3d87 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:13.265911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e560f5c-a1b6-43ba-b657-8c59077e3d87 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:13.267261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 683/1339] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:13.272981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67757dc-92ed-4419-aaad-5085a5e9026f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:13.273425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67757dc-92ed-4419-aaad-5085a5e9026f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:13.273683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67757dc-92ed-4419-aaad-5085a5e9026f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:13.344309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c67757dc-92ed-4419-aaad-5085a5e9026f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:13.345500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c67757dc-92ed-4419-aaad-5085a5e9026f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:13.437275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:13.451586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 657/1340] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:13.738855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e560f5c-a1b6-43ba-b657-8c59077e3d87 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:13.740431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3e560f5c-a1b6-43ba-b657-8c59077e3d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:13.791413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:13.855334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e560f5c-a1b6-43ba-b657-8c59077e3d87 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:13.929517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:13.930136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:13.930443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:13.930741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:13.932406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:14.026355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:14.043467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:14.044942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f3edbd-b42f-4338-8dfe-709a10128cee service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:14.063758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 684/1341] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:16.636262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64675b-71ab-4bf5-b87f-3fc8c44b39bb None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:16.636782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64675b-71ab-4bf5-b87f-3fc8c44b39bb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:16.636782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd64675b-71ab-4bf5-b87f-3fc8c44b39bb None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:16.638113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 658/1342] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:16.644686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e6220-88e4-41a3-972e-a0cbe0523e6e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:16.645285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e6220-88e4-41a3-972e-a0cbe0523e6e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:16.645385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5e6220-88e4-41a3-972e-a0cbe0523e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:16.714331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7e5e6220-88e4-41a3-972e-a0cbe0523e6e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:16.715553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7e5e6220-88e4-41a3-972e-a0cbe0523e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:16.811969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 685/1343] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:16 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:17.095144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64675b-71ab-4bf5-b87f-3fc8c44b39bb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:17.096683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dd64675b-71ab-4bf5-b87f-3fc8c44b39bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:17.202496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd64675b-71ab-4bf5-b87f-3fc8c44b39bb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:17.281795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:17.282411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:17.282697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:17.283003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:17.285277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:17.332071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:17.402492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:17.403957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b00052d-3d3f-4558-b25d-9b3df3a7fcf2 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:17.423895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 659/1344] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:21.349575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd643666-533e-4a0f-922d-ea016bd68fff None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:21.350078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd643666-533e-4a0f-922d-ea016bd68fff None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:21.350170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd643666-533e-4a0f-922d-ea016bd68fff None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:21.351500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 686/1345] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:21.356584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9860-cc1b-48c3-b652-9d249d44da6e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:21.357000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9860-cc1b-48c3-b652-9d249d44da6e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:21.357703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f9860-cc1b-48c3-b652-9d249d44da6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:21.443893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-295f9860-cc1b-48c3-b652-9d249d44da6e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:21.445207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-295f9860-cc1b-48c3-b652-9d249d44da6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:21.547972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:21.551022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 660/1346] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:21.839741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd643666-533e-4a0f-922d-ea016bd68fff None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:21.841284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dd643666-533e-4a0f-922d-ea016bd68fff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:21.903315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:21.954026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd643666-533e-4a0f-922d-ea016bd68fff None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:22.029910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:22.030475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:22.030813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:22.031093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:22.032723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:22.142524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:22.146675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:22.148146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d2772a-0c3d-436e-a847-46a1cd758c4a service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:22.166355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 687/1347] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:27.122080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae9ab6-90d1-434e-9105-320e2e4bcb71 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:27.122539 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae9ab6-90d1-434e-9105-320e2e4bcb71 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:27.122691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eae9ab6-90d1-434e-9105-320e2e4bcb71 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:27.124657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 661/1348] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:27.131697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e19a-fe5e-4769-b3b7-2ec83eabac6d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:27.132434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e19a-fe5e-4769-b3b7-2ec83eabac6d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:27.132876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac7e19a-fe5e-4769-b3b7-2ec83eabac6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:27.220812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-3ac7e19a-fe5e-4769-b3b7-2ec83eabac6d None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:27.222602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3ac7e19a-fe5e-4769-b3b7-2ec83eabac6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:27.355959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 688/1349] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:19:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:31.823447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbcd00-63ca-421b-a98c-99cbf4e599f4 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:31.823996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbcd00-63ca-421b-a98c-99cbf4e599f4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:31.823996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdbcd00-63ca-421b-a98c-99cbf4e599f4 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:31.825543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 662/1350] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:31.831155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc07e-a0f1-4da6-b9f0-b521a5bb8609 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:31.831636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc07e-a0f1-4da6-b9f0-b521a5bb8609 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:31.831929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fc07e-a0f1-4da6-b9f0-b521a5bb8609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:31.886737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:31.911603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6c8fc07e-a0f1-4da6-b9f0-b521a5bb8609 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:31.912945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6c8fc07e-a0f1-4da6-b9f0-b521a5bb8609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:32.032583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 689/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:19:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:33.285187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd14e8-e757-43f4-ba8e-7a103f4a2c46 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:33.285689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd14e8-e757-43f4-ba8e-7a103f4a2c46 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:33.285689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd14e8-e757-43f4-ba8e-7a103f4a2c46 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:33.287217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 663/1352] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:19:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:33.292102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179edc6-c9a0-47f1-9b73-97e9bb980ec1 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:33.292489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179edc6-c9a0-47f1-9b73-97e9bb980ec1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:33.292721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179edc6-c9a0-47f1-9b73-97e9bb980ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:33.373666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8179edc6-c9a0-47f1-9b73-97e9bb980ec1 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:33.374898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8179edc6-c9a0-47f1-9b73-97e9bb980ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:33.416476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:33.485148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 690/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:19:33 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:36.828688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd66074-5b1a-4ea0-b1be-b330d2c9ea3c None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:36.829242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd66074-5b1a-4ea0-b1be-b330d2c9ea3c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:36.829242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd66074-5b1a-4ea0-b1be-b330d2c9ea3c None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:36.830586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 664/1354] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:36.835689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bfe6-3b0e-4627-9dc5-3d635ce36f42 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:36.836092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bfe6-3b0e-4627-9dc5-3d635ce36f42 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:36.836243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6798bfe6-3b0e-4627-9dc5-3d635ce36f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:36.916983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6798bfe6-3b0e-4627-9dc5-3d635ce36f42 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:36.918188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6798bfe6-3b0e-4627-9dc5-3d635ce36f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:37.053275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 691/1355] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:37.367406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491495-16c0-47c6-a6bc-e5933639469e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:37.367756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491495-16c0-47c6-a6bc-e5933639469e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:37.367962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d491495-16c0-47c6-a6bc-e5933639469e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:37.369489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 665/1356] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 17 23:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:37.381339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307da9d-a347-4e9e-8e27-52459abff062 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:37.382008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307da9d-a347-4e9e-8e27-52459abff062 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:37.382509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307da9d-a347-4e9e-8e27-52459abff062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:37.409023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:37.475265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a307da9d-a347-4e9e-8e27-52459abff062 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:37.476585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a307da9d-a347-4e9e-8e27-52459abff062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:37.625139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 692/1357] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 17 23:19:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:37.633339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491495-16c0-47c6-a6bc-e5933639469e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:37.635010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7d491495-16c0-47c6-a6bc-e5933639469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:37.792396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d491495-16c0-47c6-a6bc-e5933639469e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:37.871783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:37.915959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:37.916660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:37.917005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:37.917340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:37.919027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:38.010052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:38.011759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867f0fa3-db1f-4c66-a336-4a661f095e14 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:38.031598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 666/1358] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:19:40.170232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7ce4-7414-463b-9997-5d1fc4c599fb None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:40.170959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7ce4-7414-463b-9997-5d1fc4c599fb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:40.170959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bd7ce4-7414-463b-9997-5d1fc4c599fb None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:40.176615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 693/1359] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:40.178402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c820e54-b3de-4325-904e-e30204d33d7f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:40.178818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c820e54-b3de-4325-904e-e30204d33d7f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:40.179082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c820e54-b3de-4325-904e-e30204d33d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:40.254683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3c820e54-b3de-4325-904e-e30204d33d7f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:40.256019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3c820e54-b3de-4325-904e-e30204d33d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:40.299476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:40.365621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 667/1360] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:40.669177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7ce4-7414-463b-9997-5d1fc4c599fb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:40.671384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e0bd7ce4-7414-463b-9997-5d1fc4c599fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:40.771667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:40.867150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bd7ce4-7414-463b-9997-5d1fc4c599fb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:40.991268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:40.991894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:40.992184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:40.992464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:40.994115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:41.022877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:41.099340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:41.101193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057588e6-7d6e-4b2f-9d7b-41035a07d6ad service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:41.120859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 694/1361] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:43.403879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce826a6-2d28-439b-a43f-c75b5ca45d63 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:43.404402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce826a6-2d28-439b-a43f-c75b5ca45d63 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:43.404529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce826a6-2d28-439b-a43f-c75b5ca45d63 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:43.406126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 668/1362] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:43.411323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554649-e278-417f-a463-d323c95b4eaa None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:43.411819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554649-e278-417f-a463-d323c95b4eaa None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:43.411901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9554649-e278-417f-a463-d323c95b4eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:43.485224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f9554649-e278-417f-a463-d323c95b4eaa None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:43.486447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f9554649-e278-417f-a463-d323c95b4eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:43.587701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:43.599016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 695/1363] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:43.884412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857b9c-bc5e-4be7-88fa-e8a7af0a33d8 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:43.884713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857b9c-bc5e-4be7-88fa-e8a7af0a33d8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:43.885141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5857b9c-bc5e-4be7-88fa-e8a7af0a33d8 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:43.886831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 669/1364] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 17 23:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:43.892658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad19e04-ab59-4f49-986c-76d3ac0bb088 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:43.893014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad19e04-ab59-4f49-986c-76d3ac0bb088 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:43.893388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad19e04-ab59-4f49-986c-76d3ac0bb088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:43.972637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1ad19e04-ab59-4f49-986c-76d3ac0bb088 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:43.973876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1ad19e04-ab59-4f49-986c-76d3ac0bb088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:44.096867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 696/1365] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 17 23:19:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:44.104394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5857b9c-bc5e-4be7-88fa-e8a7af0a33d8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:44.105914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e5857b9c-bc5e-4be7-88fa-e8a7af0a33d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:44.266564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5857b9c-bc5e-4be7-88fa-e8a7af0a33d8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:44.299878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:44.404462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:44.405111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:44.405394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:44.405632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:44.407300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:44.501785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:44.503781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe66d8-8e0d-4bf9-832c-d87aead2a7ed service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:44.525159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 670/1366] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:45.199821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dd2a-9eab-4922-95bf-18b26a9aa16f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:45.200363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dd2a-9eab-4922-95bf-18b26a9aa16f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:45.200363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d302dd2a-9eab-4922-95bf-18b26a9aa16f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:45.202619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 697/1367] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:45.207724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1fbfa-330d-465d-a3e0-594d197d76e7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:45.208021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1fbfa-330d-465d-a3e0-594d197d76e7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:45.208299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d1fbfa-330d-465d-a3e0-594d197d76e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:45.246589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:45.293991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-71d1fbfa-330d-465d-a3e0-594d197d76e7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:45.295861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-71d1fbfa-330d-465d-a3e0-594d197d76e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:45.402370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 671/1368] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:45.995970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f137-6184-4481-adaf-a3e1010009d3 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:45.995970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f137-6184-4481-adaf-a3e1010009d3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:45.995970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832f137-6184-4481-adaf-a3e1010009d3 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:45.999237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 698/1369] 10.222.0.39 () {54 vars in 964 bytes} [Wed Aug 17 23:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:46.002605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33b7ea-6f5e-4c72-9f22-c22b61b66330 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:46.003128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33b7ea-6f5e-4c72-9f22-c22b61b66330 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:46.003292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f33b7ea-6f5e-4c72-9f22-c22b61b66330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:46.083336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8f33b7ea-6f5e-4c72-9f22-c22b61b66330 None None] MFA Rules not processed for user `8a1775415549435c96a6e22ff0fd6911`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:46.084559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8f33b7ea-6f5e-4c72-9f22-c22b61b66330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:46.132806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:46.170514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 672/1370] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Aug 17 23:19:46 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:46.173021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f137-6184-4481-adaf-a3e1010009d3 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:46.174636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d832f137-6184-4481-adaf-a3e1010009d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:46.228473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:46.292983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832f137-6184-4481-adaf-a3e1010009d3 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:46.394588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:46.395285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:46.395564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:46.396027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:46.397604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:46.538579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653403-9e32-4da9-aaf3-2b830251296d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:46.540621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653403-9e32-4da9-aaf3-2b830251296d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:46.540621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5653403-9e32-4da9-aaf3-2b830251296d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:46.540621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 673/1371] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:46.547142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210057-847a-44e7-90a9-1e047e08760f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:46.547142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210057-847a-44e7-90a9-1e047e08760f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:46.547142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e210057-847a-44e7-90a9-1e047e08760f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:46.625964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9e210057-847a-44e7-90a9-1e047e08760f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:46.627232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9e210057-847a-44e7-90a9-1e047e08760f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:46.652705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:46.672383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:46.676208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:46.704104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 699/1372] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:46.743075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 674/1373] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:19:47.033281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:47.034493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:47.131394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025136a3-1cca-455f-8843-8c7e81aba6ce service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:47.233453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:47.246327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:47.246975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:47.247297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:47.247574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:47.249190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:47.342002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:47.343641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eca7be-2f3b-4b24-bde1-88c41522c366 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:47.363070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 700/1374] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:49.322509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be390ece-4eb7-40c8-9e7a-973bc2dc0167 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:49.323287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be390ece-4eb7-40c8-9e7a-973bc2dc0167 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:49.323287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be390ece-4eb7-40c8-9e7a-973bc2dc0167 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:49.324468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 675/1375] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:49.330184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af358f-1f47-442a-884a-ae05462db321 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:49.330576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af358f-1f47-442a-884a-ae05462db321 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:49.330782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4af358f-1f47-442a-884a-ae05462db321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:49.415200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c4af358f-1f47-442a-884a-ae05462db321 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:49.416336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c4af358f-1f47-442a-884a-ae05462db321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:49.473884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:49.512486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 701/1376] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:49.802385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be390ece-4eb7-40c8-9e7a-973bc2dc0167 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:49.804075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-be390ece-4eb7-40c8-9e7a-973bc2dc0167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:49.864748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:49.962621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be390ece-4eb7-40c8-9e7a-973bc2dc0167 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:50.082439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:50.083102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:50.083390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:50.083667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:50.085274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:50.097440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:50.198229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:50.200179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97f2808-3034-4a33-aa8a-7cd78d1f4694 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:50.219508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 676/1377] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:52.211992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4fe8-513f-49bc-a7c3-9137c1658d32 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:52.212598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4fe8-513f-49bc-a7c3-9137c1658d32 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:52.212598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2c4fe8-513f-49bc-a7c3-9137c1658d32 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:52.214035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 702/1378] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:52.220201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7887c-868a-4445-8ab6-7672b7a25919 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:52.220664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7887c-868a-4445-8ab6-7672b7a25919 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:52.220747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a7887c-868a-4445-8ab6-7672b7a25919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:52.295636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c6a7887c-868a-4445-8ab6-7672b7a25919 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:52.296924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c6a7887c-868a-4445-8ab6-7672b7a25919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:52.396111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:52.410837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 677/1379] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:52.702068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4fe8-513f-49bc-a7c3-9137c1658d32 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:52.703605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7f2c4fe8-513f-49bc-a7c3-9137c1658d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:52.858021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2c4fe8-513f-49bc-a7c3-9137c1658d32 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:52.918180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:52.990581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:52.991138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:52.991438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:52.991699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:52.993376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:53.089910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:53.092479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878075d1-0e9e-49ff-b3d9-c3fc66e23c4e service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:53.114376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 703/1380] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:55.092744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d52a7-4565-42c6-9bb5-f69c14cf9f35 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:55.093277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d52a7-4565-42c6-9bb5-f69c14cf9f35 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:55.093277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5d52a7-4565-42c6-9bb5-f69c14cf9f35 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:55.094724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 678/1381] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:55.100184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e86d6e-8202-4c33-bbc2-3d9b1a659f63 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:55.100753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e86d6e-8202-4c33-bbc2-3d9b1a659f63 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:55.100753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e86d6e-8202-4c33-bbc2-3d9b1a659f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:55.188355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-77e86d6e-8202-4c33-bbc2-3d9b1a659f63 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:55.190036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-77e86d6e-8202-4c33-bbc2-3d9b1a659f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:55.193009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:55.322114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 704/1382] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:55.618580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d52a7-4565-42c6-9bb5-f69c14cf9f35 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:55.620177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8c5d52a7-4565-42c6-9bb5-f69c14cf9f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:55.777156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5d52a7-4565-42c6-9bb5-f69c14cf9f35 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:55.843397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:55.896465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:55.896990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:55.897270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:55.897551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:55.899189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:56.014365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:56.016051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543ce247-06cf-4eb9-99c9-f055ec802af8 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:56.035674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 679/1383] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:19:57.969790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11eab6-0d0a-4683-a480-8fc84b783f3c None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:57.970359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11eab6-0d0a-4683-a480-8fc84b783f3c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:57.970359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd11eab6-0d0a-4683-a480-8fc84b783f3c None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:57.971723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 705/1384] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:19:57.976986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dba7ad-5537-4ad8-bdbf-f8ca530e43af None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:57.977417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dba7ad-5537-4ad8-bdbf-f8ca530e43af None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:57.977527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dba7ad-5537-4ad8-bdbf-f8ca530e43af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:58.046450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f9dba7ad-5537-4ad8-bdbf-f8ca530e43af None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:19:58.047702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f9dba7ad-5537-4ad8-bdbf-f8ca530e43af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:58.074017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:58.146232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 680/1385] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:19:58.445900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11eab6-0d0a-4683-a480-8fc84b783f3c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:19:58.447549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fd11eab6-0d0a-4683-a480-8fc84b783f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:58.612125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:58.630263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd11eab6-0d0a-4683-a480-8fc84b783f3c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:19:58.750332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:19:58.750987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:19:58.751274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:19:58.751547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:19:58.753143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:19:58.850318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:19:58.852015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5ec87b-510f-4104-a4f7-49637ba17fb9 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:19:58.858423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:19:58.874002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 706/1386] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:19:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:00.861081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e592eb-7922-4adf-8b3c-56ab7bf4695f None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:00.861659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e592eb-7922-4adf-8b3c-56ab7bf4695f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:00.861659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e592eb-7922-4adf-8b3c-56ab7bf4695f None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:00.863063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 681/1387] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:00.868292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d501e3-5dc3-4538-92ad-b527cc5bb7a7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:00.868755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d501e3-5dc3-4538-92ad-b527cc5bb7a7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:00.868866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d501e3-5dc3-4538-92ad-b527cc5bb7a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:00.935625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-57d501e3-5dc3-4538-92ad-b527cc5bb7a7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:00.936869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-57d501e3-5dc3-4538-92ad-b527cc5bb7a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:01.042966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 707/1388] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:01.340204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e592eb-7922-4adf-8b3c-56ab7bf4695f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:01.342089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-87e592eb-7922-4adf-8b3c-56ab7bf4695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:01.490971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e592eb-7922-4adf-8b3c-56ab7bf4695f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:01.501538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:01.609441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:01.609974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:01.610259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:01.610535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:01.612201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:01.704856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:01.706504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf690b10-ee08-4e63-a900-367724f2a3e0 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:01.724867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 682/1389] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:01.934512 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ebd9-0ec7-46b2-a845-9bd55ff55745 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:01.935318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ebd9-0ec7-46b2-a845-9bd55ff55745 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:01.935318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67ebd9-0ec7-46b2-a845-9bd55ff55745 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:01.936406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 708/1390] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:01.941662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311d25-7c1f-41c8-83b8-c5a7556775a4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:01.942110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311d25-7c1f-41c8-83b8-c5a7556775a4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:01.942214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e311d25-7c1f-41c8-83b8-c5a7556775a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:01.958020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:02.012378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6e311d25-7c1f-41c8-83b8-c5a7556775a4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:02.013623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6e311d25-7c1f-41c8-83b8-c5a7556775a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:02.112265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 683/1391] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:02.411937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f3152-4cb8-45e7-ab3b-5897d9dfdc6b None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:02.412227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f3152-4cb8-45e7-ab3b-5897d9dfdc6b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:02.412504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2f3152-4cb8-45e7-ab3b-5897d9dfdc6b None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:02.413890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 709/1392] 10.222.0.39 () {54 vars in 967 bytes} [Wed Aug 17 23:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:02.419596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451792-14a4-4661-9e1e-31928cbc5583 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:02.420159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451792-14a4-4661-9e1e-31928cbc5583 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:02.420441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca451792-14a4-4661-9e1e-31928cbc5583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:02.495276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ca451792-14a4-4661-9e1e-31928cbc5583 None None] MFA Rules not processed for user `dfaa389252804cb980cf4fc92928000d`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:02.496530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ca451792-14a4-4661-9e1e-31928cbc5583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:02.532001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:02.574622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 684/1393] 10.222.0.39 () {58 vars in 1064 bytes} [Wed Aug 17 23:20:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:02.582329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f3152-4cb8-45e7-ab3b-5897d9dfdc6b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:02.583864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4e2f3152-4cb8-45e7-ab3b-5897d9dfdc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:02.658114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:02.688889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2f3152-4cb8-45e7-ab3b-5897d9dfdc6b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:02.764628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:02.765283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:02.765558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:02.765831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:02.767454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:02.880454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:02.882059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a95920-e679-47b1-b970-3c8329f38b71 service glance] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:02.899129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:02.911097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 710/1394] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:03.657976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dafd7a-6f86-462c-86dc-cfcd75e9d25b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:03.658535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dafd7a-6f86-462c-86dc-cfcd75e9d25b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:03.658535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dafd7a-6f86-462c-86dc-cfcd75e9d25b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:03.696759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115725-3138-4666-8655-51dbb5272063 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:03.697604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115725-3138-4666-8655-51dbb5272063 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:03.697917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13115725-3138-4666-8655-51dbb5272063 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:03.699658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 711/1395] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:20:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:03.706233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:03.706517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:03.706819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:03.731255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f0dafd7a-6f86-462c-86dc-cfcd75e9d25b None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:03.733302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f0dafd7a-6f86-462c-86dc-cfcd75e9d25b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:03.774962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:03.776183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:03.821534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 685/1396] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:03.870516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fabc2c-eaeb-4d75-81f1-d085bb478705 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:03.870845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fabc2c-eaeb-4d75-81f1-d085bb478705 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:03.871235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fabc2c-eaeb-4d75-81f1-d085bb478705 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:03.872550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 686/1397] 10.222.0.39 () {54 vars in 943 bytes} [Wed Aug 17 23:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:20:03.878467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:03.878781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:03.879064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:03.879674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 712/1398] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:20:03.938360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:03.957321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] MFA Rules not processed for user `53bb1987763944d3935ee9479b8032f3`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:03.958541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:04.070396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 687/1399] 10.222.0.39 () {58 vars in 1040 bytes} [Wed Aug 17 23:20:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:20:04.085260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:04.086472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:04.161800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:04.183620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:04.185344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:04.190966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c61bfba-52d2-4ccf-8520-fd5749009e7f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:04.290992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dff995-3b41-4768-ae5b-f75cf7c9d625 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:04.300475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:04.301083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:04.301364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:04.301640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:04.303303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:04.306095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:04.388844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:04.390454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58c05ca-4e9a-485d-bb52-d3aa1e7d25fe service swift] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:04.398763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 713/1400] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:20:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:20:04.412592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:04.413222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:04.413553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:04.413742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:04.415407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:04.517181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:04.518959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72e9dbc-698f-4375-9b4a-865960cffd13 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:04.540677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 688/1401] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:20:06.558368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc28dfe-7d8e-49ef-bf22-547b2adae93d None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:06.558963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc28dfe-7d8e-49ef-bf22-547b2adae93d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:06.558963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc28dfe-7d8e-49ef-bf22-547b2adae93d None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:06.564770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 714/1402] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:20:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:06.566502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815387-f857-4313-bd4a-c037290a9512 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:06.566996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815387-f857-4313-bd4a-c037290a9512 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:06.567096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815387-f857-4313-bd4a-c037290a9512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:06.597230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:06.660900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-49815387-f857-4313-bd4a-c037290a9512 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:06.662490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-49815387-f857-4313-bd4a-c037290a9512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:06.771269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 689/1403] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:20:07.065587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc28dfe-7d8e-49ef-bf22-547b2adae93d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:07.067204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9cc28dfe-7d8e-49ef-bf22-547b2adae93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:07.083452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:07.238564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc28dfe-7d8e-49ef-bf22-547b2adae93d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:07.335046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:07.369769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:07.370415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:07.370740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:07.371030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:07.373269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:07.478651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:07.480316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20966e26-4e93-4447-90da-90ce74c13dd1 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:07.502486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 715/1404] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:09.467614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781707d4-3db5-48c9-9e03-2ca07b3ebb3e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:09.467614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781707d4-3db5-48c9-9e03-2ca07b3ebb3e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:09.467614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781707d4-3db5-48c9-9e03-2ca07b3ebb3e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:09.469073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 690/1405] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:20:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:09.476113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ba2ae-3c3f-47dc-a8fa-1086321f7483 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:09.476606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ba2ae-3c3f-47dc-a8fa-1086321f7483 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:09.476704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93ba2ae-3c3f-47dc-a8fa-1086321f7483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:09.552164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c93ba2ae-3c3f-47dc-a8fa-1086321f7483 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:09.553292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c93ba2ae-3c3f-47dc-a8fa-1086321f7483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:09.605173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:09.665985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 716/1406] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:09.966293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781707d4-3db5-48c9-9e03-2ca07b3ebb3e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:09.968370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-781707d4-3db5-48c9-9e03-2ca07b3ebb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:10.077405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:10.142321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781707d4-3db5-48c9-9e03-2ca07b3ebb3e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:10.282308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:10.282908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:10.283194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:10.283507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:10.285310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:10.350360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:10.386152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:10.388879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6983d09-694b-4c84-87ec-0be828d43441 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:10.410810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 691/1407] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:19.664012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=22 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:20.408047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=19 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:26.615219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144d37-7761-422c-a63c-25ae46f14ae3 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:26.615746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144d37-7761-422c-a63c-25ae46f14ae3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:26.615746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd144d37-7761-422c-a63c-25ae46f14ae3 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:26.617026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 717/1408] 10.222.0.39 () {54 vars in 918 bytes} [Wed Aug 17 23:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:26.622526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560a5e8-008f-4651-bffe-cc8cd2912c79 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:26.622997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560a5e8-008f-4651-bffe-cc8cd2912c79 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:26.623130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1560a5e8-008f-4651-bffe-cc8cd2912c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:26.700508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1560a5e8-008f-4651-bffe-cc8cd2912c79 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:26.701715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1560a5e8-008f-4651-bffe-cc8cd2912c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:26.806162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 692/1409] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 17 23:20:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:26.820718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d46b4-4714-4330-95ec-a9d4d6d61c41 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:26.821007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d46b4-4714-4330-95ec-a9d4d6d61c41 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:26.821285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584d46b4-4714-4330-95ec-a9d4d6d61c41 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:26.822601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 718/1410] 10.222.0.39 () {54 vars in 918 bytes} [Wed Aug 17 23:20:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:26.828048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646b17-1a7f-4078-a9c2-514c68e8697d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:26.828336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646b17-1a7f-4078-a9c2-514c68e8697d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:26.828612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a646b17-1a7f-4078-a9c2-514c68e8697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:26.900423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:26.904552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-4a646b17-1a7f-4078-a9c2-514c68e8697d None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:26.906572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4a646b17-1a7f-4078-a9c2-514c68e8697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:27.022845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 693/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Wed Aug 17 23:20:26 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:29.434075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869705-b1df-4f7f-b849-5dcc69efaa2f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:29.434619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869705-b1df-4f7f-b849-5dcc69efaa2f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:29.434619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6869705-b1df-4f7f-b849-5dcc69efaa2f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:29.435923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 719/1412] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:29.441206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417427f-f047-47a9-8cd2-c986aeaf96cd None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:29.441611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417427f-f047-47a9-8cd2-c986aeaf96cd None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:29.441768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2417427f-f047-47a9-8cd2-c986aeaf96cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:29.507167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2417427f-f047-47a9-8cd2-c986aeaf96cd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:29.508376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2417427f-f047-47a9-8cd2-c986aeaf96cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:29.563707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:29.607415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 694/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:29.899773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6869705-b1df-4f7f-b849-5dcc69efaa2f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:29.901359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f6869705-b1df-4f7f-b849-5dcc69efaa2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:30.060678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6869705-b1df-4f7f-b849-5dcc69efaa2f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:30.132077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:30.172891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:30.173421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:30.173704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:30.173978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:30.175601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:30.262454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:30.264068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66312a3d-eb6d-4e51-a4ce-c53937eb2460 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:30.282312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 720/1414] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:31.203692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5092e-bc64-488f-88f7-baca819a02b2 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:31.204224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5092e-bc64-488f-88f7-baca819a02b2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:31.204224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc5092e-bc64-488f-88f7-baca819a02b2 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:31.205601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 695/1415] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:31.210375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159077-7ed5-4515-a1c0-3137b8ae03d7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:31.210828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159077-7ed5-4515-a1c0-3137b8ae03d7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:31.210962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44159077-7ed5-4515-a1c0-3137b8ae03d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:31.287776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-44159077-7ed5-4515-a1c0-3137b8ae03d7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:31.288983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-44159077-7ed5-4515-a1c0-3137b8ae03d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:31.316299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:31.385439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 721/1416] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:31.540142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5092e-bc64-488f-88f7-baca819a02b2 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:31.541605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9cc5092e-bc64-488f-88f7-baca819a02b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:31.690098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc5092e-bc64-488f-88f7-baca819a02b2 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:31.732296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:31.809985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:31.810499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:31.810812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:31.811093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:31.812705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:31.903857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:31.905470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a13443-7d80-437c-93e0-86c7ed8ba76d service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:31.924173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 696/1417] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:32.818888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e2a5-3d9d-4fff-ae3b-af7a1a05528a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:32.819431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e2a5-3d9d-4fff-ae3b-af7a1a05528a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:32.819431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca4e2a5-3d9d-4fff-ae3b-af7a1a05528a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:32.820773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 722/1418] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:32.825917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458b3a-adc7-49ca-9feb-fc01009f91be None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:32.826351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458b3a-adc7-49ca-9feb-fc01009f91be None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:32.826462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb458b3a-adc7-49ca-9feb-fc01009f91be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:32.882522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:32.905805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-eb458b3a-adc7-49ca-9feb-fc01009f91be None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:32.907082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eb458b3a-adc7-49ca-9feb-fc01009f91be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:33.003267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 697/1419] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:20:33.153068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e2a5-3d9d-4fff-ae3b-af7a1a05528a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:33.154493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3ca4e2a5-3d9d-4fff-ae3b-af7a1a05528a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:33.300877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca4e2a5-3d9d-4fff-ae3b-af7a1a05528a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:33.313136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:33.412954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:33.413484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:33.413764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:33.414038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:33.415664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:33.502521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:33.504139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f5b4a-aee6-4599-bacb-df7422001dc5 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:33.521641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 723/1420] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:34.398041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c8e13-7f10-44a1-afd8-016111176554 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:34.398566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c8e13-7f10-44a1-afd8-016111176554 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:34.398682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c8e13-7f10-44a1-afd8-016111176554 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:34.399982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 698/1421] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:34.405409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9c80-dc7e-41c4-a3d5-21fe2845d1fa None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:34.405827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9c80-dc7e-41c4-a3d5-21fe2845d1fa None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:34.405946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e9c80-dc7e-41c4-a3d5-21fe2845d1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:34.425593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:34.483285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2d6e9c80-dc7e-41c4-a3d5-21fe2845d1fa None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:34.484497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2d6e9c80-dc7e-41c4-a3d5-21fe2845d1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:34.581454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 724/1422] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:34.739198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c8e13-7f10-44a1-afd8-016111176554 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:34.740776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-325c8e13-7f10-44a1-afd8-016111176554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:34.851183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:34.887533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c8e13-7f10-44a1-afd8-016111176554 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:34.998564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:34.999202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:34.999480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:34.999757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:35.001349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:35.080794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:35.095249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:35.096849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2941baf6-64a3-4f9c-98e4-701786240f26 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:35.115334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 699/1423] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:35.982150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292cc6-bc55-48db-a2fc-1e708e1c880a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:35.982744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292cc6-bc55-48db-a2fc-1e708e1c880a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:35.982744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36292cc6-bc55-48db-a2fc-1e708e1c880a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:35.984180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 725/1424] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:35.989127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f76cb-8b13-4b85-b63b-d58c57a26770 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:35.989546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f76cb-8b13-4b85-b63b-d58c57a26770 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:35.989684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84f76cb-8b13-4b85-b63b-d58c57a26770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:36.066472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a84f76cb-8b13-4b85-b63b-d58c57a26770 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:36.067700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a84f76cb-8b13-4b85-b63b-d58c57a26770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:36.164073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 700/1425] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:36.324062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36292cc6-bc55-48db-a2fc-1e708e1c880a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:36.325571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-36292cc6-bc55-48db-a2fc-1e708e1c880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:36.408719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:36.473408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36292cc6-bc55-48db-a2fc-1e708e1c880a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:36.584149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:36.584707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:36.584989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:36.585264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:36.586869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:36.635049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:36.676415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:36.678022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ff2f42-1311-4b00-b91e-c504098b9bda service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:36.695757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 726/1426] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:37.503090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622f85-73c6-4cfa-905c-1ac066e19f7c None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:37.503673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622f85-73c6-4cfa-905c-1ac066e19f7c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:37.503673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab622f85-73c6-4cfa-905c-1ac066e19f7c None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:37.505000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 701/1427] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:37.509998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238a82-98eb-46f8-97c2-b027f3e4dea8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:37.510438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238a82-98eb-46f8-97c2-b027f3e4dea8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:37.510545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9238a82-98eb-46f8-97c2-b027f3e4dea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:37.590167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e9238a82-98eb-46f8-97c2-b027f3e4dea8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:37.591314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e9238a82-98eb-46f8-97c2-b027f3e4dea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:37.690589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 727/1428] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:37.841497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab622f85-73c6-4cfa-905c-1ac066e19f7c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:37.843191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ab622f85-73c6-4cfa-905c-1ac066e19f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:37.893140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:37.991301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab622f85-73c6-4cfa-905c-1ac066e19f7c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:38.102883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:38.103419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:38.103704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:38.103979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:38.105624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:38.112592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:38.200427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:38.202033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a82fa5-08ad-496c-97cb-fd1c7d2fad80 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:38.220524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 702/1429] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:39.020560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee70f-ffeb-4989-b6e4-0a6069994f3f None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:39.021672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee70f-ffeb-4989-b6e4-0a6069994f3f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:39.021766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcee70f-ffeb-4989-b6e4-0a6069994f3f None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:39.023140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 728/1430] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:39.028662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa281bf7-92f4-401f-94f2-6b6fdd1f1950 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:39.029059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa281bf7-92f4-401f-94f2-6b6fdd1f1950 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:39.029204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa281bf7-92f4-401f-94f2-6b6fdd1f1950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:39.104229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-aa281bf7-92f4-401f-94f2-6b6fdd1f1950 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:39.105477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-aa281bf7-92f4-401f-94f2-6b6fdd1f1950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:39.171578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:39.201901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 703/1431] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:39.354690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee70f-ffeb-4989-b6e4-0a6069994f3f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:39.356401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1bcee70f-ffeb-4989-b6e4-0a6069994f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:39.373974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:39.501936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcee70f-ffeb-4989-b6e4-0a6069994f3f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:39.587517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:39.614473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:39.615054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:39.615340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:39.615616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:39.617209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:39.708703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:39.710333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72924215-5a9d-41f1-a2e5-a2b615353ead service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:39.728687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 729/1432] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:40.541457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8b021-7c2d-4985-a3f5-4655bafb06cd None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:40.542066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8b021-7c2d-4985-a3f5-4655bafb06cd None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:40.542066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d8b021-7c2d-4985-a3f5-4655bafb06cd None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:40.543363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 704/1433] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:40.548400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c5048-ffaf-41eb-8853-0335631a36c0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:40.548847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c5048-ffaf-41eb-8853-0335631a36c0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:40.548955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546c5048-ffaf-41eb-8853-0335631a36c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:40.625386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-546c5048-ffaf-41eb-8853-0335631a36c0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:40.626843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-546c5048-ffaf-41eb-8853-0335631a36c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:40.669541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:40.727636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 730/1434] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:40.878858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8b021-7c2d-4985-a3f5-4655bafb06cd None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:40.880281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-85d8b021-7c2d-4985-a3f5-4655bafb06cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:41.028423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d8b021-7c2d-4985-a3f5-4655bafb06cd None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:41.082448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:41.141647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:41.142180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:41.142458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:41.142753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:41.144352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:41.232429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:41.234020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24862c49-5750-4a9a-98f6-4009f8b8e27a service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:41.252237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 705/1435] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:42.058604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf5cd-4b94-401d-b222-96d9f4d84a74 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:42.059275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf5cd-4b94-401d-b222-96d9f4d84a74 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:42.059275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adcf5cd-4b94-401d-b222-96d9f4d84a74 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:42.060543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 731/1436] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:20:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:42.065363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd056ab-a45a-4498-9c24-1bc64435512c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:42.065762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd056ab-a45a-4498-9c24-1bc64435512c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:42.065925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd056ab-a45a-4498-9c24-1bc64435512c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:42.140823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-4cd056ab-a45a-4498-9c24-1bc64435512c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:42.142024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4cd056ab-a45a-4498-9c24-1bc64435512c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:42.144071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:42.240224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 706/1437] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:20:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:42.392156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcf5cd-4b94-401d-b222-96d9f4d84a74 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:42.393583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9adcf5cd-4b94-401d-b222-96d9f4d84a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:42.539045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adcf5cd-4b94-401d-b222-96d9f4d84a74 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:42.565908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:42.652428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:42.652895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:42.653175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:42.653447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:42.655062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:42.742009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:42.743638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c9a2bd-f780-4c45-b23b-05a77fad10d3 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:42.762435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 732/1438] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:44.595771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0489ee-a48e-48a0-8d28-755dd3cd1990 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:44.596275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0489ee-a48e-48a0-8d28-755dd3cd1990 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:44.596275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0489ee-a48e-48a0-8d28-755dd3cd1990 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:44.597597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 707/1439] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:44.602985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702c91b-4d55-48f7-b8b2-4477c1ec6563 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:44.603418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702c91b-4d55-48f7-b8b2-4477c1ec6563 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:44.603541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702c91b-4d55-48f7-b8b2-4477c1ec6563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:44.646694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:44.672968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-5702c91b-4d55-48f7-b8b2-4477c1ec6563 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:44.674181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5702c91b-4d55-48f7-b8b2-4477c1ec6563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:44.768044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 733/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:45.052259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0489ee-a48e-48a0-8d28-755dd3cd1990 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:45.053818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ee0489ee-a48e-48a0-8d28-755dd3cd1990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:45.156127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0489ee-a48e-48a0-8d28-755dd3cd1990 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:45.188460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:45.230152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:45.230829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:45.231118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:45.231392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:45.232995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:45.341729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:45.343211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66528f95-4093-4c5a-aa69-9d672872ee44 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:45.361484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 708/1441] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:47.445382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e7db-bdff-4690-86a1-1424c43d30c3 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:47.445927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e7db-bdff-4690-86a1-1424c43d30c3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:47.445927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a526e7db-bdff-4690-86a1-1424c43d30c3 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:47.447321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 734/1442] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:47.453396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed02dc-948d-494b-90e2-8d98507c12fc None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:47.453808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed02dc-948d-494b-90e2-8d98507c12fc None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:47.453971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ed02dc-948d-494b-90e2-8d98507c12fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:47.521904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e3ed02dc-948d-494b-90e2-8d98507c12fc None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:47.523152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e3ed02dc-948d-494b-90e2-8d98507c12fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:47.536867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:47.623735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 709/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:47.915684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526e7db-bdff-4690-86a1-1424c43d30c3 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:47.917966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a526e7db-bdff-4690-86a1-1424c43d30c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:48.020866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a526e7db-bdff-4690-86a1-1424c43d30c3 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:48.033007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:48.093673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:48.094279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:48.094563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:48.094878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:48.096465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:48.203724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:48.205171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23198b-72fa-472e-906e-95e13708bb39 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:48.223404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 735/1444] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:50.464004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31016e8-6472-42ce-9fec-1042e85d6bf8 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:50.464557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31016e8-6472-42ce-9fec-1042e85d6bf8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:50.464557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31016e8-6472-42ce-9fec-1042e85d6bf8 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:50.465934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 710/1445] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:50.473516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448c190-a78d-4ae8-b08b-a208f0713cb8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:50.474004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448c190-a78d-4ae8-b08b-a208f0713cb8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:50.474126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448c190-a78d-4ae8-b08b-a208f0713cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:50.522987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:50.542141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1448c190-a78d-4ae8-b08b-a208f0713cb8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:50.543523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1448c190-a78d-4ae8-b08b-a208f0713cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:50.639954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 736/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:50.931896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31016e8-6472-42ce-9fec-1042e85d6bf8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:50.934027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d31016e8-6472-42ce-9fec-1042e85d6bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:51.036472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31016e8-6472-42ce-9fec-1042e85d6bf8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:51.077063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:51.111237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:51.111844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:51.112129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:51.112405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:51.113990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:51.220969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:51.222345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007952c9-d437-410d-9d6a-2b7223972dd7 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:51.240425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 711/1447] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:53.278346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b14a0-8aa4-46bc-9678-da97f548dae0 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:53.278971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b14a0-8aa4-46bc-9678-da97f548dae0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:53.278971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b14a0-8aa4-46bc-9678-da97f548dae0 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:53.280277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 737/1448] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:53.285938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec3074-87bd-4298-a76a-5cb9812f765e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:53.286383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec3074-87bd-4298-a76a-5cb9812f765e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:53.286500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cec3074-87bd-4298-a76a-5cb9812f765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:53.352456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5cec3074-87bd-4298-a76a-5cb9812f765e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:53.353653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5cec3074-87bd-4298-a76a-5cb9812f765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:53.375137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:53.451064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 712/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:53.739228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b14a0-8aa4-46bc-9678-da97f548dae0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:53.740787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a18b14a0-8aa4-46bc-9678-da97f548dae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:53.845699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b14a0-8aa4-46bc-9678-da97f548dae0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:53.865050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:53.920029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:53.920635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:53.920916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:53.921187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:53.922847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:54.031897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:54.033248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a608db4-9d0b-42c4-aeae-3b61a2c0cd02 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:54.051500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 738/1450] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:56.111679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fd9ab-d49e-4f5c-b434-4d527e442163 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:56.112247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fd9ab-d49e-4f5c-b434-4d527e442163 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:56.112247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395fd9ab-d49e-4f5c-b434-4d527e442163 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:56.113590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 713/1451] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:56.119519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72248fd-6c49-4cca-93b7-b3578416753f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:56.120029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72248fd-6c49-4cca-93b7-b3578416753f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:56.120185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72248fd-6c49-4cca-93b7-b3578416753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:56.185229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:56.189390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d72248fd-6c49-4cca-93b7-b3578416753f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:56.190803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d72248fd-6c49-4cca-93b7-b3578416753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:56.287057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 739/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:56.570125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fd9ab-d49e-4f5c-b434-4d527e442163 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:56.571825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-395fd9ab-d49e-4f5c-b434-4d527e442163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:56.676310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395fd9ab-d49e-4f5c-b434-4d527e442163 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:56.730634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:56.755767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:56.756374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:56.756654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:56.756926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:56.758524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:56.868042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:56.869937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1523baaf-3286-4fc2-8fd6-f54cee2bc959 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:56.888262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 714/1453] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:20:58.834907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc71e-5a6d-42c6-a872-d668ab5cdb15 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:58.835457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc71e-5a6d-42c6-a872-d668ab5cdb15 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:58.835457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18bc71e-5a6d-42c6-a872-d668ab5cdb15 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:58.836814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 740/1454] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:58.842207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc131a31-051d-4b0b-96b5-8e8663c2f755 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:58.842648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc131a31-051d-4b0b-96b5-8e8663c2f755 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:58.842824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc131a31-051d-4b0b-96b5-8e8663c2f755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:58.910587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-cc131a31-051d-4b0b-96b5-8e8663c2f755 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:58.911849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cc131a31-051d-4b0b-96b5-8e8663c2f755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:58.941380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:59.015691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 715/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:59.313349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018e4ac-2943-4852-8755-854a0abfe5e2 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:59.313638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018e4ac-2943-4852-8755-854a0abfe5e2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:59.313917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e018e4ac-2943-4852-8755-854a0abfe5e2 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:59.315301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 741/1456] 10.222.0.39 () {54 vars in 965 bytes} [Wed Aug 17 23:20:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:20:59.321219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006d73-6ce4-4b25-ab54-0d77d1db5230 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:59.321509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006d73-6ce4-4b25-ab54-0d77d1db5230 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:59.321785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f006d73-6ce4-4b25-ab54-0d77d1db5230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:59.396709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2f006d73-6ce4-4b25-ab54-0d77d1db5230 None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:20:59.397921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2f006d73-6ce4-4b25-ab54-0d77d1db5230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:59.474505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 716/1457] 10.222.0.39 () {58 vars in 1062 bytes} [Wed Aug 17 23:20:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:20:59.484361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018e4ac-2943-4852-8755-854a0abfe5e2 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:20:59.485969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e018e4ac-2943-4852-8755-854a0abfe5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:59.595762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e018e4ac-2943-4852-8755-854a0abfe5e2 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:20:59.625305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:20:59.672639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:20:59.673251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:20:59.673531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:20:59.673807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:20:59.675436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:20:59.783815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:20:59.785252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530a319-c877-42b5-b611-b80b282a51bf service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:20:59.804200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 742/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:20:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:02.254760 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b652b-8704-4ef1-b869-f51b25faf65d None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:02.255295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b652b-8704-4ef1-b869-f51b25faf65d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:02.255390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b652b-8704-4ef1-b869-f51b25faf65d None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:02.256692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 717/1459] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:21:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:02.262684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7335c-f1be-497c-a659-df5265b3e1b9 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:02.263153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7335c-f1be-497c-a659-df5265b3e1b9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:02.263275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec7335c-f1be-497c-a659-df5265b3e1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:02.329926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-aec7335c-f1be-497c-a659-df5265b3e1b9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:02.331153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-aec7335c-f1be-497c-a659-df5265b3e1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:02.339895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:02.426674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 743/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:02.712286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b652b-8704-4ef1-b869-f51b25faf65d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:02.714543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f80b652b-8704-4ef1-b869-f51b25faf65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:02.743839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:02.825261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b652b-8704-4ef1-b869-f51b25faf65d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:02.899027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:02.899635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:02.899913 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:02.900277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:02.902369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:02.977764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:03.011503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:03.012939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1116372e-f15d-4ab1-a8fc-a167e643bf28 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:03.031206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 718/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:04.997322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0608b-43d7-40d9-84d7-d6123f19bee6 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:04.997911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0608b-43d7-40d9-84d7-d6123f19bee6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:04.997911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a0608b-43d7-40d9-84d7-d6123f19bee6 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:04.999235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 744/1462] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:05.004396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbcc7-2eed-45b9-b2eb-24ebbbb9673e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:05.004822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbcc7-2eed-45b9-b2eb-24ebbbb9673e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:05.004947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6cbcc7-2eed-45b9-b2eb-24ebbbb9673e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:05.070998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8c6cbcc7-2eed-45b9-b2eb-24ebbbb9673e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:05.072286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8c6cbcc7-2eed-45b9-b2eb-24ebbbb9673e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:05.171274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 719/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:05.457530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0608b-43d7-40d9-84d7-d6123f19bee6 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:05.459107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f9a0608b-43d7-40d9-84d7-d6123f19bee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:05.573029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a0608b-43d7-40d9-84d7-d6123f19bee6 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:05.610937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:05.647157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:05.647766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:05.648049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:05.648325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:05.650424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:05.760581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:05.762051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b3d1f-011e-484f-85f0-3d2b9e6c7e6e service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:05.780979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 745/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:07.690695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d718-7b91-4303-b356-4e40a71e6b86 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:07.691282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d718-7b91-4303-b356-4e40a71e6b86 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:07.691282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1d718-7b91-4303-b356-4e40a71e6b86 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:07.692554 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 720/1465] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:07.698386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d166-3749-4efc-a1f7-fd893aa0b7b1 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:07.698835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d166-3749-4efc-a1f7-fd893aa0b7b1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:07.698972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b070d166-3749-4efc-a1f7-fd893aa0b7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:07.765051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b070d166-3749-4efc-a1f7-fd893aa0b7b1 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:07.766248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b070d166-3749-4efc-a1f7-fd893aa0b7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:07.784753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:07.863306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 746/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:08.152691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d718-7b91-4303-b356-4e40a71e6b86 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:08.154273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-94a1d718-7b91-4303-b356-4e40a71e6b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:08.192585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:08.260498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1d718-7b91-4303-b356-4e40a71e6b86 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:08.335482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:08.336111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:08.336391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:08.336662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:08.338651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:08.423247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:08.451518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:08.452967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b5922-4619-49bd-b2ba-b410c373fce5 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:08.471329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 721/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:10.381652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8394-6f87-48b2-9d4b-7b8ca02bf899 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:10.382183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8394-6f87-48b2-9d4b-7b8ca02bf899 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:10.382183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9d8394-6f87-48b2-9d4b-7b8ca02bf899 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:10.383558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 747/1468] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:10.388847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309a44-6941-4073-984d-8be1b0365f49 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:10.389252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309a44-6941-4073-984d-8be1b0365f49 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:10.389412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa309a44-6941-4073-984d-8be1b0365f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:10.462007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-aa309a44-6941-4073-984d-8be1b0365f49 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:10.465285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-aa309a44-6941-4073-984d-8be1b0365f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:10.565303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 722/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:10.845878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8394-6f87-48b2-9d4b-7b8ca02bf899 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:10.847439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3d9d8394-6f87-48b2-9d4b-7b8ca02bf899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:10.949792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9d8394-6f87-48b2-9d4b-7b8ca02bf899 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:10.996669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:11.022505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:11.023151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:11.023438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:11.023715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:11.026208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:11.133174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:11.134823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94113b55-3058-49a7-8fd9-07fda0d87715 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:11.153640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 748/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:20.563616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=81 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:21.151333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=66 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:30.884887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fe8c-6467-472e-86fa-d4c82a07cff7 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:30.885425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fe8c-6467-472e-86fa-d4c82a07cff7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:30.885425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b5fe8c-6467-472e-86fa-d4c82a07cff7 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:30.886807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 723/1471] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:30.891936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947915b-ffed-43c9-8335-05edcfe31fd8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:30.892333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947915b-ffed-43c9-8335-05edcfe31fd8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:30.892478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f947915b-ffed-43c9-8335-05edcfe31fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:30.957493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f947915b-ffed-43c9-8335-05edcfe31fd8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:30.958690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f947915b-ffed-43c9-8335-05edcfe31fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:31.054029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 749/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:21:31.350291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061fe9e-952a-44fb-a397-40a0e5b684d5 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:31.350578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061fe9e-952a-44fb-a397-40a0e5b684d5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:31.350881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1061fe9e-952a-44fb-a397-40a0e5b684d5 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:31.352308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 724/1473] 10.222.0.39 () {54 vars in 967 bytes} [Wed Aug 17 23:21:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:31.357309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aab09b-3071-49d2-8860-0b13fa76c638 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:31.357602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aab09b-3071-49d2-8860-0b13fa76c638 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:31.357879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aab09b-3071-49d2-8860-0b13fa76c638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:31.434321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-00aab09b-3071-49d2-8860-0b13fa76c638 None None] MFA Rules not processed for user `dfaa389252804cb980cf4fc92928000d`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:31.435564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-00aab09b-3071-49d2-8860-0b13fa76c638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:31.456199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:31.510970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 750/1474] 10.222.0.39 () {58 vars in 1064 bytes} [Wed Aug 17 23:21:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:31.518920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061fe9e-952a-44fb-a397-40a0e5b684d5 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:31.520568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1061fe9e-952a-44fb-a397-40a0e5b684d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:31.624342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1061fe9e-952a-44fb-a397-40a0e5b684d5 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:31.697953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:31.698556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:31.698868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:31.699147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:31.700745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:31.753756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:31.810650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:31.812130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ae35a-4b52-4e43-9ea1-c3f41e489b49 service glance] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:31.831145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 725/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:33.854488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f396ce-f294-4fbd-a0c1-751286b31ade None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:33.855078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f396ce-f294-4fbd-a0c1-751286b31ade None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:33.855078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f396ce-f294-4fbd-a0c1-751286b31ade None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:33.856414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 751/1476] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:33.861525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238eace-9d3a-47fb-ac6c-811cff0a6757 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:33.861946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238eace-9d3a-47fb-ac6c-811cff0a6757 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:33.862086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238eace-9d3a-47fb-ac6c-811cff0a6757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:33.928810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9238eace-9d3a-47fb-ac6c-811cff0a6757 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:33.930024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9238eace-9d3a-47fb-ac6c-811cff0a6757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:34.028632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 726/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:34.302519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f396ce-f294-4fbd-a0c1-751286b31ade None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:34.304082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-33f396ce-f294-4fbd-a0c1-751286b31ade None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:34.427520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f396ce-f294-4fbd-a0c1-751286b31ade None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:34.475934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:34.520447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:34.521050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:34.521695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:34.521966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:34.522607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:34.525005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:21:34.525005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:21:34.525005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:21:34.526571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e6d0ae-750f-4ab9-aee9-cb3da7755ca0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:34.546038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 752/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Wed Aug 17 23:21:34 2022] GET /identity/v3/projects => generated 2553 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:21:36.487605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e70c-ae07-486d-999e-956d90c43825 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:36.488131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e70c-ae07-486d-999e-956d90c43825 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:36.488262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0723e70c-ae07-486d-999e-956d90c43825 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:36.489526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 727/1479] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:36.495188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a94ef-53fd-4089-8198-b59127aee6b5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:36.495609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a94ef-53fd-4089-8198-b59127aee6b5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:36.495749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011a94ef-53fd-4089-8198-b59127aee6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:36.561920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-011a94ef-53fd-4089-8198-b59127aee6b5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:36.563074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-011a94ef-53fd-4089-8198-b59127aee6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:36.659290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 753/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:36.955416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723e70c-ae07-486d-999e-956d90c43825 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:36.957022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0723e70c-ae07-486d-999e-956d90c43825 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:36.967548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:37.103098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0723e70c-ae07-486d-999e-956d90c43825 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:37.189032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:37.222034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:37.222573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:37.222883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:37.223156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:37.224755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:37.315986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:37.317579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7a7be-c8cc-4fdf-85e1-c92f14df8b6a service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:37.336361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 728/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:39.435336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a29b9e-00c2-4626-83b2-00c0b8dd531a None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:39.435917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a29b9e-00c2-4626-83b2-00c0b8dd531a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:39.435917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a29b9e-00c2-4626-83b2-00c0b8dd531a None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:39.437253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 754/1482] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:39.442522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460e1bc-04e3-4904-afcf-9fd8c03e69e3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:39.442990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460e1bc-04e3-4904-afcf-9fd8c03e69e3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:39.443101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c460e1bc-04e3-4904-afcf-9fd8c03e69e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:39.631311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c460e1bc-04e3-4904-afcf-9fd8c03e69e3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:39.633219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c460e1bc-04e3-4904-afcf-9fd8c03e69e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:39.680150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:39.730433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 729/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:21:40.021889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a29b9e-00c2-4626-83b2-00c0b8dd531a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:40.024117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-62a29b9e-00c2-4626-83b2-00c0b8dd531a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:40.047719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:40.127324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a29b9e-00c2-4626-83b2-00c0b8dd531a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:40.200185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:40.200718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:40.201007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:40.201280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:40.202901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:40.277555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:40.313137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:40.314574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e0f288-e018-4182-9542-d609616eaad8 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:40.332939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 755/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:42.306718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af563e-31f4-4b13-af65-623d82b212eb None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:42.307185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af563e-31f4-4b13-af65-623d82b212eb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:42.307302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af563e-31f4-4b13-af65-623d82b212eb None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:42.308855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 730/1485] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:42.313985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca193239-4750-4233-9ba4-9da2acc9417c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:42.314415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca193239-4750-4233-9ba4-9da2acc9417c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:42.314518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca193239-4750-4233-9ba4-9da2acc9417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:42.379340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ca193239-4750-4233-9ba4-9da2acc9417c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:42.380543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ca193239-4750-4233-9ba4-9da2acc9417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:42.477440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 756/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:42.767859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af563e-31f4-4b13-af65-623d82b212eb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:42.769392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-52af563e-31f4-4b13-af65-623d82b212eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:42.872212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af563e-31f4-4b13-af65-623d82b212eb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:42.946070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:42.947972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:42.948592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:42.949065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:42.949537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:42.951374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:43.062832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:43.064306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0837261b-10ce-4230-bad0-ec9cc259f2b6 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:43.081948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 731/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:45.083654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1b92-1fa0-4d7b-ba34-3c4834ad1724 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:45.084106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1b92-1fa0-4d7b-ba34-3c4834ad1724 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:45.084214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873e1b92-1fa0-4d7b-ba34-3c4834ad1724 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:45.086119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 757/1488] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:45.091377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1bc9-f20d-4c5d-bb23-b331bc409d00 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:45.091881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1bc9-f20d-4c5d-bb23-b331bc409d00 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:45.091993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a1bc9-f20d-4c5d-bb23-b331bc409d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:45.156552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-cb4a1bc9-f20d-4c5d-bb23-b331bc409d00 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:45.157738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cb4a1bc9-f20d-4c5d-bb23-b331bc409d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:45.223251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:45.266819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 732/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:21:45.571702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1b92-1fa0-4d7b-ba34-3c4834ad1724 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:45.573227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-873e1b92-1fa0-4d7b-ba34-3c4834ad1724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:45.608649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:45.677763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873e1b92-1fa0-4d7b-ba34-3c4834ad1724 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:45.749958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:45.750576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:45.750890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:45.751168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:45.752781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:45.831455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:45.860651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:45.862115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7503abb7-a1cc-4005-a8b4-dbce3424d2f4 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:45.880635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 758/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:21:47.971885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145185f-f907-4ad5-af02-08efd2126487 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:47.972469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145185f-f907-4ad5-af02-08efd2126487 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:47.972469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3145185f-f907-4ad5-af02-08efd2126487 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:47.973805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 733/1491] 10.222.0.39 () {54 vars in 927 bytes} [Wed Aug 17 23:21:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:21:47.979442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86288d-aa47-446b-98ce-ef885c8ed8c7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:47.979888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86288d-aa47-446b-98ce-ef885c8ed8c7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:47.979994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e86288d-aa47-446b-98ce-ef885c8ed8c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:48.047806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1e86288d-aa47-446b-98ce-ef885c8ed8c7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:21:48.049016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1e86288d-aa47-446b-98ce-ef885c8ed8c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:48.142736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 759/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Wed Aug 17 23:21:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:21:48.431295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145185f-f907-4ad5-af02-08efd2126487 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:21:48.432864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3145185f-f907-4ad5-af02-08efd2126487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:48.535058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3145185f-f907-4ad5-af02-08efd2126487 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:21:48.608422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:21:48.608950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:21:48.609233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:21:48.609507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:21:48.611127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:21:48.620642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:48.724609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:21:48.726067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dfab13-d1a2-45c0-a0f6-6c4f950adebb service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:21:48.744695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 734/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:21:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:21:58.140937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=82 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:21:58.741755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=50 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:06.311501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:06.312011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:06.312115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:06.386936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:23:06.388138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:06.482073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 760/1494] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:23:06.490248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:06.490755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:06.490864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:06.567741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:23:06.568874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:06.664397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 735/1495] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:23:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:23:06.669082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:06.670284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:06.681812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce56080b-86a2-4bcf-955d-046ca2b048ab None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:06.742993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:06.775707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:06.776310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:06.776596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:06.776869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:06.777512 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:23:06.777812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:06.778865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:06.778865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:23:06.778865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:23:06.779748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:06.791093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 761/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:23:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:23:06.799378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:06.809179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa9aebe-1747-49c9-8f84-9aebd4e86115 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:06.872301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:06.905300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:06.905902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:06.906180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:06.906450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:06.907106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:06.908847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:06.908847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:23:06.908847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:23:06.910026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:06.965392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 736/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:23:06 2022] POST /identity/v3/projects => generated 377 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:23:06.969624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:06.971213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:07.004693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5414c56b-4cb4-4f22-a4c4-02aaccf45788 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:07.096351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:07.096962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.097244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.097520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.098138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:07.099187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:07.099187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:23:07.099187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:23:07.100401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:07.142310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 762/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:23:06 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:23:07.146396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:07.148659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:07.211601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc931c0e-52a8-4089-b166-13c092a4b384 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:07.296342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:07.307840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:07.308452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.308826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.309101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.309751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:07.310815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:07.310815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:23:07.310815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:23:07.311702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:07.324157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 737/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:23:07.328142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:07.329663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:07.341902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e476629-600b-4b22-a98a-d030f01a4ee5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:07.367297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:07.437860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:07.438391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.438669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.438973 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.439614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:07.440622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:07.440622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:23:07.440622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:23:07.441542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff1f0b0-f1d8-457b-90fd-15ba5f004d9e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:07.454209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 763/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:23:07 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:23:07.458344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:07.459907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:07.494303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8348081a-ebbd-4678-9582-f1a6fcface50 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:07.590915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:07.591624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.591890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.592163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] PATH_INFO: `/v3/projects/80610f01b80446ce8fddb55dfb9435e3/users/de6ea0a780494cfc987149d0581b8bfa/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.614385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80610f01b80446ce8fddb55dfb9435e3, user_id=de6ea0a780494cfc987149d0581b8bfa, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:07.615477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:07.615477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:23:07.615477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:23:07.618037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c478f59-5c02-4865-a33a-e700bbbd5210 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:07.642159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 738/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:23:07 2022] PUT /identity/v3/projects/80610f01b80446ce8fddb55dfb9435e3/users/de6ea0a780494cfc987149d0581b8bfa/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:23:07.654431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81e31-fc2d-408a-875a-d204ba663d0e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.654744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81e31-fc2d-408a-875a-d204ba663d0e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.655028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf81e31-fc2d-408a-875a-d204ba663d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.713697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cbf81e31-fc2d-408a-875a-d204ba663d0e None None] MFA Rules not processed for user `de6ea0a780494cfc987149d0581b8bfa`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:23:07.714877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cbf81e31-fc2d-408a-875a-d204ba663d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:07.795777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 764/1502] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:23:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:23:07.809791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c710f-a3cc-4a9a-ae20-712f429ba69b None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.810080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c710f-a3cc-4a9a-ae20-712f429ba69b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.810361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2c710f-a3cc-4a9a-ae20-712f429ba69b None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.811730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 739/1503] 10.222.0.39 () {54 vars in 964 bytes} [Wed Aug 17 23:23:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:23:07.816638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927606a-2e41-46d8-9bc5-6b6b42a50361 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:07.816930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927606a-2e41-46d8-9bc5-6b6b42a50361 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:07.817210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b927606a-2e41-46d8-9bc5-6b6b42a50361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:07.847956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:07.891642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b927606a-2e41-46d8-9bc5-6b6b42a50361 None None] MFA Rules not processed for user `8a1775415549435c96a6e22ff0fd6911`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:23:07.892846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b927606a-2e41-46d8-9bc5-6b6b42a50361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:07.968944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 765/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Wed Aug 17 23:23:07 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:23:07.977201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c710f-a3cc-4a9a-ae20-712f429ba69b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:07.978807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4c2c710f-a3cc-4a9a-ae20-712f429ba69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:08.029134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:08.086451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2c710f-a3cc-4a9a-ae20-712f429ba69b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:08.157774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:08.158387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:08.158676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:08.158969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:08.161626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:08.262177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:08.263660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:08.267112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:08.283565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 740/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:23:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:23:08.333397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d1089-9ffe-437d-94fe-4146d89236c4 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:08.333848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d1089-9ffe-437d-94fe-4146d89236c4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:08.333965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56d1089-9ffe-437d-94fe-4146d89236c4 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:08.335978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 766/1506] 10.222.0.39 () {52 vars in 830 bytes} [Wed Aug 17 23:23:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:23:08.339724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:08.340929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:08.439352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53e12-6baa-4faf-9f7c-09368392e05f service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:08.532631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:08.533252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:08.533473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:08.533742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] PATH_INFO: `/v3/users/de6ea0a780494cfc987149d0581b8bfa` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:08.546018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6ea0a780494cfc987149d0581b8bfa)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:08.547092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:08.547092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:23:08.547092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:23:08.548294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:08.558630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:08.616633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6ea0a780494cfc987149d0581b8bfa'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:08.639483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6ea0a780494cfc987149d0581b8bfa'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:08.649405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6ea0a780494cfc987149d0581b8bfa'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:08.649897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6ea0a780494cfc987149d0581b8bfa'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:08.666667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6ea0a780494cfc987149d0581b8bfa'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:08.672282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 741/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:23:08 2022] DELETE /identity/v3/users/de6ea0a780494cfc987149d0581b8bfa => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:23:08.676653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:08.676938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:08.677233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:08.734659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:23:08.735884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:08.809635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:08.822495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 767/1508] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:23:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:23:08.831935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:08.833154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:08.935284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c1cf8-3bf9-4cef-b686-55b0db4adf88 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:08.989135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:09.010377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:09.011014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:09.011295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:09.011565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:09.013142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:09.120689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:09.122122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7675bfa-2197-48c7-8b7a-94e4caf0008d service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:09.140588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 742/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:23:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:23:09.499210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:23:09.500501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:23:09.512752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf336-87e4-45d2-a2e5-ffdbb5257ab1 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:23:09.613255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:23:09.613893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:23:09.614169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:23:09.614441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] PATH_INFO: `/v3/projects/80610f01b80446ce8fddb55dfb9435e3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:23:09.625181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80610f01b80446ce8fddb55dfb9435e3)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:23:09.626134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:23:09.626134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:23:09.626134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:23:09.627369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:23:09.686439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80610f01b80446ce8fddb55dfb9435e3', 'request_id': 'req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:09.692431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80610f01b80446ce8fddb55dfb9435e3', 'request_id': 'req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:09.701975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80610f01b80446ce8fddb55dfb9435e3', 'request_id': 'req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:09.731534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] The token cache is being invalidate because project 80610f01b80446ce8fddb55dfb9435e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:23:09.731830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:09.732354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a7f3216b-23fe-49f2-9687-f1ab46b6de0e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:23:09.733665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 768/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:23:09 2022] DELETE /identity/v3/projects/80610f01b80446ce8fddb55dfb9435e3 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:23:19.138415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=62 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:23:19.729530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:24:46.628734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf274-0172-4eb7-be49-804bc0df8210 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:46.629291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf274-0172-4eb7-be49-804bc0df8210 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:46.629291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559cf274-0172-4eb7-be49-804bc0df8210 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:46.630577 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 743/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:24:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:24:46.635984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7ee3-6cfc-497f-8b5a-d2191e2e242c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:46.636435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7ee3-6cfc-497f-8b5a-d2191e2e242c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:46.636540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276c7ee3-6cfc-497f-8b5a-d2191e2e242c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:46.719764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-276c7ee3-6cfc-497f-8b5a-d2191e2e242c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:24:46.720975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-276c7ee3-6cfc-497f-8b5a-d2191e2e242c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:24:46.827483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 769/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:24:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:24:46.989960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf274-0172-4eb7-be49-804bc0df8210 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:24:46.992074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-559cf274-0172-4eb7-be49-804bc0df8210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:24:47.111818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559cf274-0172-4eb7-be49-804bc0df8210 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:24:47.117162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5013d7ea-700b-483a-b20c-26397989051b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:24:47.117761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013d7ea-700b-483a-b20c-26397989051b service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:47.118043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013d7ea-700b-483a-b20c-26397989051b service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:47.118318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5013d7ea-700b-483a-b20c-26397989051b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:47.126763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013d7ea-700b-483a-b20c-26397989051b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:24:47.128331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5013d7ea-700b-483a-b20c-26397989051b service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:24:47.137531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 744/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:24:47.972403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8dc75-98ac-4aa4-8787-faf12dede7b3 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:47.972929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8dc75-98ac-4aa4-8787-faf12dede7b3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:47.972929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f8dc75-98ac-4aa4-8787-faf12dede7b3 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:47.974212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 770/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:24:47.979571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1de4-8ca8-45d2-a035-a502387026da None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:47.979974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1de4-8ca8-45d2-a035-a502387026da None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:47.980125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a1de4-8ca8-45d2-a035-a502387026da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:47.999277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-919a1de4-8ca8-45d2-a035-a502387026da None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:24:48.000447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-919a1de4-8ca8-45d2-a035-a502387026da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:24:48.008084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 745/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:24:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:24:48.161558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8dc75-98ac-4aa4-8787-faf12dede7b3 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:24:48.176479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f8dc75-98ac-4aa4-8787-faf12dede7b3 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:24:48.183718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a0f8a5-419d-4412-8901-bebecfb008bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:24:48.184321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0f8a5-419d-4412-8901-bebecfb008bc service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:48.184599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0f8a5-419d-4412-8901-bebecfb008bc service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:48.184868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a0f8a5-419d-4412-8901-bebecfb008bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:48.192933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0f8a5-419d-4412-8901-bebecfb008bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:24:48.194505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a0f8a5-419d-4412-8901-bebecfb008bc service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:24:48.204622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 771/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:24:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:24:48.558147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e77a0-10fe-46b3-a98b-5260a016cabe None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:48.558457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e77a0-10fe-46b3-a98b-5260a016cabe None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:48.558751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e77a0-10fe-46b3-a98b-5260a016cabe None None] PATH_INFO: `/v3` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:48.560041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 746/1517] 10.222.0.52 () {54 vars in 925 bytes} [Wed Aug 17 23:24:48 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:24:48.569034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1646c-980e-49a1-9744-1cc15dff23e3 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:48.569323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1646c-980e-49a1-9744-1cc15dff23e3 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:48.569603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1646c-980e-49a1-9744-1cc15dff23e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:48.628197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a8d1646c-980e-49a1-9744-1cc15dff23e3 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:24:48.629415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a8d1646c-980e-49a1-9744-1cc15dff23e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:24:48.646999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:24:48.702134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 772/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 17 23:24:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:24:52.545753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224584a3-5401-4466-8a03-4b3ba4894e3f None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:52.546200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224584a3-5401-4466-8a03-4b3ba4894e3f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:52.546309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224584a3-5401-4466-8a03-4b3ba4894e3f None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:52.547673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 747/1519] 10.222.0.39 () {54 vars in 961 bytes} [Wed Aug 17 23:24:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:24:52.552709 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bcd78-2e81-44ce-9673-16879618684d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:52.553131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bcd78-2e81-44ce-9673-16879618684d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:52.553260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062bcd78-2e81-44ce-9673-16879618684d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:52.573205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-062bcd78-2e81-44ce-9673-16879618684d None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:24:52.574404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-062bcd78-2e81-44ce-9673-16879618684d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:24:52.582839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 773/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Aug 17 23:24:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:24:52.590293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224584a3-5401-4466-8a03-4b3ba4894e3f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:24:52.606269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224584a3-5401-4466-8a03-4b3ba4894e3f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:24:52.611158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804b0ec-889a-4cb0-a45c-f0eb9e0caa29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:24:52.611741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804b0ec-889a-4cb0-a45c-f0eb9e0caa29 service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:52.612021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804b0ec-889a-4cb0-a45c-f0eb9e0caa29 service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:52.612293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804b0ec-889a-4cb0-a45c-f0eb9e0caa29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:52.621452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804b0ec-889a-4cb0-a45c-f0eb9e0caa29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:24:52.623043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804b0ec-889a-4cb0-a45c-f0eb9e0caa29 service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:24:52.632346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 748/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:24:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:24:59.446607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb378-699e-4a9a-86a1-8f054aebedf9 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:59.447906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb378-699e-4a9a-86a1-8f054aebedf9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:59.447906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fedb378-699e-4a9a-86a1-8f054aebedf9 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:59.449037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 774/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:24:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:24:59.453803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36ce29-9f10-4540-9c3c-5bd91033f53a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:59.454206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36ce29-9f10-4540-9c3c-5bd91033f53a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:59.454359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36ce29-9f10-4540-9c3c-5bd91033f53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:59.473651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8b36ce29-9f10-4540-9c3c-5bd91033f53a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:24:59.474884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8b36ce29-9f10-4540-9c3c-5bd91033f53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:24:59.483132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 749/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:24:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:24:59.638105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb378-699e-4a9a-86a1-8f054aebedf9 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:24:59.653594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fedb378-699e-4a9a-86a1-8f054aebedf9 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:24:59.659119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126a417c-8355-4b42-a76e-5cbebb8fcbe0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:24:59.659719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a417c-8355-4b42-a76e-5cbebb8fcbe0 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:24:59.660009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a417c-8355-4b42-a76e-5cbebb8fcbe0 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:24:59.660291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126a417c-8355-4b42-a76e-5cbebb8fcbe0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:24:59.668574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a417c-8355-4b42-a76e-5cbebb8fcbe0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:24:59.670161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126a417c-8355-4b42-a76e-5cbebb8fcbe0 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:24:59.679609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 775/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:24:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:25:00.495897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16459052-c76b-4c67-be8d-5cf976d98743 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:00.496430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16459052-c76b-4c67-be8d-5cf976d98743 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:00.496430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16459052-c76b-4c67-be8d-5cf976d98743 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:00.497815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 750/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Aug 17 23:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:25:00.502511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf58f3-6356-48dc-8fa8-5a88eb84c029 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:00.502975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf58f3-6356-48dc-8fa8-5a88eb84c029 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:00.503099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf58f3-6356-48dc-8fa8-5a88eb84c029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:00.522605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cccf58f3-6356-48dc-8fa8-5a88eb84c029 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:25:00.524112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cccf58f3-6356-48dc-8fa8-5a88eb84c029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:00.532073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 776/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Aug 17 23:25:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:25:00.685326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16459052-c76b-4c67-be8d-5cf976d98743 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:25:00.700252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16459052-c76b-4c67-be8d-5cf976d98743 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:25:00.705550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccb8e67-a664-4927-ab90-5365b75a8e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:25:00.706139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb8e67-a664-4927-ab90-5365b75a8e99 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:00.706418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb8e67-a664-4927-ab90-5365b75a8e99 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:00.706688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccb8e67-a664-4927-ab90-5365b75a8e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:00.715324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb8e67-a664-4927-ab90-5365b75a8e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:25:00.716891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccb8e67-a664-4927-ab90-5365b75a8e99 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:25:00.726078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 751/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:25:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:25:04.465850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fe794-0b9e-409c-8fd3-45df7cc74891 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:04.466446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fe794-0b9e-409c-8fd3-45df7cc74891 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:04.466446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089fe794-0b9e-409c-8fd3-45df7cc74891 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:04.467771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 777/1528] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:25:04.472789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e975a-a540-431f-be4e-fa4017e0095e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:04.473194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e975a-a540-431f-be4e-fa4017e0095e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:04.473346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e975a-a540-431f-be4e-fa4017e0095e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:04.492998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-dc4e975a-a540-431f-be4e-fa4017e0095e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:25:04.494915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dc4e975a-a540-431f-be4e-fa4017e0095e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:04.502584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 752/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:25:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:25:04.808075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fe794-0b9e-409c-8fd3-45df7cc74891 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:25:04.809908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-089fe794-0b9e-409c-8fd3-45df7cc74891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:04.886950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089fe794-0b9e-409c-8fd3-45df7cc74891 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:25:04.890507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81727d17-de6d-471c-9306-813291b50153 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:25:04.891146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81727d17-de6d-471c-9306-813291b50153 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:04.891436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81727d17-de6d-471c-9306-813291b50153 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:04.891711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81727d17-de6d-471c-9306-813291b50153 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:04.900996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81727d17-de6d-471c-9306-813291b50153 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:25:04.902424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81727d17-de6d-471c-9306-813291b50153 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:25:04.911785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 778/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:25:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:25:06.815611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9940-ce7a-44ca-97ff-7997e3f4ebed None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:06.816179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9940-ce7a-44ca-97ff-7997e3f4ebed None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:06.816179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9e9940-ce7a-44ca-97ff-7997e3f4ebed None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:06.817502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 753/1531] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:25:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:25:06.822599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a05a3-29c3-45cc-84d1-88b411e3c9a9 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:06.823102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a05a3-29c3-45cc-84d1-88b411e3c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:06.823217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39a05a3-29c3-45cc-84d1-88b411e3c9a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:06.842466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b39a05a3-29c3-45cc-84d1-88b411e3c9a9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:25:06.843688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b39a05a3-29c3-45cc-84d1-88b411e3c9a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:06.851777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 779/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:25:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:25:07.148088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9940-ce7a-44ca-97ff-7997e3f4ebed None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:25:07.159371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9e9940-ce7a-44ca-97ff-7997e3f4ebed None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:25:07.162867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d611751-cc37-4c60-8dbf-6a35850b98da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:25:07.163461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611751-cc37-4c60-8dbf-6a35850b98da service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:07.163742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611751-cc37-4c60-8dbf-6a35850b98da service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:07.164014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d611751-cc37-4c60-8dbf-6a35850b98da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:07.172691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611751-cc37-4c60-8dbf-6a35850b98da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:25:07.174113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d611751-cc37-4c60-8dbf-6a35850b98da service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:25:07.183979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 754/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:25:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:25:10.587885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2a16-c76d-457d-abd0-bbbbd9025591 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:10.588430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2a16-c76d-457d-abd0-bbbbd9025591 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:10.588430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2a16-c76d-457d-abd0-bbbbd9025591 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:10.589793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 780/1534] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:25:10.594927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293c71-a2fa-4ca0-af76-f52507b02824 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:10.595352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293c71-a2fa-4ca0-af76-f52507b02824 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:10.595487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a293c71-a2fa-4ca0-af76-f52507b02824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:10.603835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=81 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:25:10.616069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5a293c71-a2fa-4ca0-af76-f52507b02824 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:25:10.617259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5a293c71-a2fa-4ca0-af76-f52507b02824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:10.625929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 755/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:25:11.177303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2a16-c76d-457d-abd0-bbbbd9025591 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:25:11.179035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a8fb2a16-c76d-457d-abd0-bbbbd9025591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:11.245148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:25:11.258288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2a16-c76d-457d-abd0-bbbbd9025591 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:25:11.262113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cf524a-5331-4de3-8b3d-45804cc5375a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:25:11.262729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf524a-5331-4de3-8b3d-45804cc5375a service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:11.263029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf524a-5331-4de3-8b3d-45804cc5375a service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:11.263302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cf524a-5331-4de3-8b3d-45804cc5375a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:11.271995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf524a-5331-4de3-8b3d-45804cc5375a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:25:11.273413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cf524a-5331-4de3-8b3d-45804cc5375a service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:25:11.283400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 781/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:25:13.227164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee471-19d8-421f-949b-d9f96e0c6d4a None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:13.227720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee471-19d8-421f-949b-d9f96e0c6d4a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:13.227873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7ee471-19d8-421f-949b-d9f96e0c6d4a None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:13.229625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 756/1537] 127.0.0.1 () {54 vars in 917 bytes} [Wed Aug 17 23:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:25:13.234619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bae00-47a7-4b95-80cb-597419f5398a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:13.235076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bae00-47a7-4b95-80cb-597419f5398a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:13.235208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0bae00-47a7-4b95-80cb-597419f5398a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:13.255254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2f0bae00-47a7-4b95-80cb-597419f5398a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:25:13.256458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2f0bae00-47a7-4b95-80cb-597419f5398a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:13.265629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 782/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Wed Aug 17 23:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:25:13.811365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee471-19d8-421f-949b-d9f96e0c6d4a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:25:13.813092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cc7ee471-19d8-421f-949b-d9f96e0c6d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:25:13.826582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7ee471-19d8-421f-949b-d9f96e0c6d4a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:25:13.830031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32113fd-5b1a-41ba-87be-65e25a62cf5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:25:13.830618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32113fd-5b1a-41ba-87be-65e25a62cf5d service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:25:13.830926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32113fd-5b1a-41ba-87be-65e25a62cf5d service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:25:13.831201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32113fd-5b1a-41ba-87be-65e25a62cf5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:25:13.840396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32113fd-5b1a-41ba-87be-65e25a62cf5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:25:13.841804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32113fd-5b1a-41ba-87be-65e25a62cf5d service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:25:13.850857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 757/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:25:23.250428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=11 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:25:23.846907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=8 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:42.456928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.458100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.458100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.483724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:42.484941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:42.500252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 783/1540] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:42.509152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c1c8-f7f1-4efc-bd27-e06bfae527ba None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.511211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c1c8-f7f1-4efc-bd27-e06bfae527ba None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.511211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a8c1c8-f7f1-4efc-bd27-e06bfae527ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.544184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-45a8c1c8-f7f1-4efc-bd27-e06bfae527ba None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:42.545361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-45a8c1c8-f7f1-4efc-bd27-e06bfae527ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:42.554759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 758/1541] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:42.559728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:42.577742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56582cbb-0bf2-4a16-92aa-06f694246d22 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:42.582831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:42.583459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.583748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.584023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.584970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:42.586733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:42.587003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:42.600402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b35a-193c-4423-a9cc-5feb1b2d7e0b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.600714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b35a-193c-4423-a9cc-5feb1b2d7e0b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.600961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d1b35a-193c-4423-a9cc-5feb1b2d7e0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.608147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 784/1542] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:42.637578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b3d1b35a-193c-4423-a9cc-5feb1b2d7e0b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:42.638520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:42.638892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b3d1b35a-193c-4423-a9cc-5feb1b2d7e0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:42.653011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 759/1543] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:42.656300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c4b66a-04d7-4073-824b-0fc7065c047b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:42.663792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.665893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.666229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.673538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:42.674466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.674813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.675782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.676549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:42.677546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:26:42.677546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:26:42.677546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:26:42.678869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:42.718891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:42.721426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:42.755617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 760/1544] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:42.765108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:42.788516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ad24c-de2e-4ede-8cac-04a88c4f4ba9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:42.788941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 785/1545] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:42.793436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:42.888683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:42.889233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.889517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.889789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.890444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:42.890765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:42.891782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:26:42.891782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:26:42.891782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:26:42.892671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746434c5-17f4-4670-b313-82b4e1d03caa admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:42.897559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0baad7b-6b82-4eb0-afb8-d27de519003e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:42.913760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:42.914552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.914877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.915264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.915919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:42.919047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:42.925874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 761/1546] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:26:42.927315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.927606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.927881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.966921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 786/1547] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/users => generated 295 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:26:42.968108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:42.973500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:42.974720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:42.985183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a761b77-75c0-4b4d-9ab3-d34953ac26e1 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:42.994854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 762/1548] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:42.995205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62a19e0-93ba-45cd-ba99-dbdc900d2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:42.995829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a19e0-93ba-45cd-ba99-dbdc900d2d6e admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:42.996038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:42.996149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a19e0-93ba-45cd-ba99-dbdc900d2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:42.996456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62a19e0-93ba-45cd-ba99-dbdc900d2d6e admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:42.997016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a19e0-93ba-45cd-ba99-dbdc900d2d6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:42.999220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62a19e0-93ba-45cd-ba99-dbdc900d2d6e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.008505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a35756-951f-4ad1-b0f1-d1f9f88cdc22 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.025545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88807b5a-391c-4161-8abb-274596a1cf2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.026855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807b5a-391c-4161-8abb-274596a1cf2d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.027168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807b5a-391c-4161-8abb-274596a1cf2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.027446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88807b5a-391c-4161-8abb-274596a1cf2d admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.028218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88807b5a-391c-4161-8abb-274596a1cf2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.030676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88807b5a-391c-4161-8abb-274596a1cf2d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.045114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 763/1549] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:43.046437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756bcca-3906-4968-9703-69a01455d922 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.051624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756bcca-3906-4968-9703-69a01455d922 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.051926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0756bcca-3906-4968-9703-69a01455d922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.075314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 787/1550] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:42 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.078111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.078654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.079246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.081699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0756bcca-3906-4968-9703-69a01455d922 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.083267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0756bcca-3906-4968-9703-69a01455d922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.103265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.105285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.147522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 764/1551] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.149065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8249-689a-49fb-8217-461e29465e3d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.149356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8249-689a-49fb-8217-461e29465e3d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.149631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed8249-689a-49fb-8217-461e29465e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.169439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b8ed8249-689a-49fb-8217-461e29465e3d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.170659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b8ed8249-689a-49fb-8217-461e29465e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.174673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 788/1552] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.175744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.185207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70becc78-15c1-45fb-8d77-4f8c0d3cb1cd None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.186934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 765/1553] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.188197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ed65-29f5-4102-9f4d-a3586bcb7c4d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.188490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ed65-29f5-4102-9f4d-a3586bcb7c4d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.188771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb1ed65-29f5-4102-9f4d-a3586bcb7c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.190216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.191004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.191292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.191572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.192226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.193841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.205359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 789/1554] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:43.206221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.208241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-eeb1ed65-29f5-4102-9f4d-a3586bcb7c4d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.209441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eeb1ed65-29f5-4102-9f4d-a3586bcb7c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.218115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70781194-660e-4fd4-b0c0-61690455e30b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.218277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 766/1555] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.219488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8ad1b-7a18-468e-8793-f50e6f4df560 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.219780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8ad1b-7a18-468e-8793-f50e6f4df560 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.220051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f8ad1b-7a18-468e-8793-f50e6f4df560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.222979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30c20be-204f-4e21-8a87-79057a7b8b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.223577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c20be-204f-4e21-8a87-79057a7b8b1d admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.223866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c20be-204f-4e21-8a87-79057a7b8b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.224146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30c20be-204f-4e21-8a87-79057a7b8b1d admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.224835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c20be-204f-4e21-8a87-79057a7b8b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.226910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30c20be-204f-4e21-8a87-79057a7b8b1d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.235206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:43.239804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-53f8ad1b-7a18-468e-8793-f50e6f4df560 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.241029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-53f8ad1b-7a18-468e-8793-f50e6f4df560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.249486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 767/1556] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.250670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 790/1557] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/users => generated 286 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.250830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.250999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.251280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.251950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80b59-c8f8-4a26-93a8-7d55b6df6237 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.252240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80b59-c8f8-4a26-93a8-7d55b6df6237 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.252520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff80b59-c8f8-4a26-93a8-7d55b6df6237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.273155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-fff80b59-c8f8-4a26-93a8-7d55b6df6237 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.273402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.274337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fff80b59-c8f8-4a26-93a8-7d55b6df6237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.281715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.283728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 791/1558] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.285075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.285372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.285652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.295364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 768/1559] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.296249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.306638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b40e4-20c1-40b8-918a-6d785ae67655 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.312340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.313138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.313423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.313705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.314364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:43.314958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.315686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.316306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfb2f7d-bc83-448c-ad9a-c379e7b694ed admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.316906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.326156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 792/1560] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.329888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.331488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 769/1561] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:43.332819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.333785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.334068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.336904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a3a38a-9745-40cd-be8c-817571835d19 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.341705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.342403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.342687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.342997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] PATH_INFO: `/v3/projects/b26992e81f65443bad90af4661ae413d/users/c7e73f3bfbcd41b29dc41bbbd218d413/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.353996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.356072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.358154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b26992e81f65443bad90af4661ae413d, user_id=c7e73f3bfbcd41b29dc41bbbd218d413, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.359234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:26:43.359234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:26:43.359234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:26:43.361191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a303ee-a99c-4c55-9626-bf781794ddc5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.364469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 770/1562] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.365300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.375103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 793/1563] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:43 2022] PUT /identity/v3/projects/b26992e81f65443bad90af4661ae413d/users/c7e73f3bfbcd41b29dc41bbbd218d413/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:43.376471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba678-b584-4c91-95b3-7069b9ba3255 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.376765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba678-b584-4c91-95b3-7069b9ba3255 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.377041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372ba678-b584-4c91-95b3-7069b9ba3255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.379698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e677bd-87b4-4c29-8d0b-139141592b58 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.388666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:43.397072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-372ba678-b584-4c91-95b3-7069b9ba3255 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.398337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-372ba678-b584-4c91-95b3-7069b9ba3255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.437931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.438550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.438865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.439138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.439786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.441384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.451962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 771/1564] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:43.452768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.463234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 794/1565] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.463234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.463234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.463234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.464190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586be31-0397-43a7-84f9-296d53146f20 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.468358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.468952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.469231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.469507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.470148 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:43.470448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.472062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.481775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.483018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.485447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 772/1566] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:43.486254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.491541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 795/1567] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.492324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.497093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cf8405-2651-40af-86e6-bd2bd562ea95 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.501970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.502237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801df0e1-cd95-476e-9f47-e2b38fcba111 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.502619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.502937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.503209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.503845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:43.504144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.505931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.507108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40451dcc-eb2b-4c83-82c7-a16ae2229851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.507715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451dcc-eb2b-4c83-82c7-a16ae2229851 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.507997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451dcc-eb2b-4c83-82c7-a16ae2229851 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.508656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40451dcc-eb2b-4c83-82c7-a16ae2229851 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.508902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40451dcc-eb2b-4c83-82c7-a16ae2229851 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.511517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40451dcc-eb2b-4c83-82c7-a16ae2229851 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.525634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 773/1568] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:43.525634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.530814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1cf87-198f-471f-9784-cc3e30ceca35 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.535905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.536501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.536790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.537068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.537714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:43.538020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.539635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.540809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 796/1569] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.545610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.545907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.546219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.552140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 774/1570] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:43.553028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.563667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fd31ac-6d88-4f95-8ee1-64cbc39d5d47 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.571384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:43.572592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:43.621226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.621840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.622128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.622431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.623116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.624730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.632468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 797/1571] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:43.633133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.634571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 775/1572] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:43.638940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.643457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff460-9b1c-4e23-a074-565d01a5ad72 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.648965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235b797-9cd9-4f8e-92c0-e38c4378f131 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.649499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.650113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.650397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.650676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.651399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:43.651711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.653315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.653759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.654373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.654653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.655077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.655764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.657740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.666386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 798/1573] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:43.673834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.677695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0945198a-d785-4654-8a8f-e8592e907276 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.682999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.683604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.683888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.684183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.684808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:43.685141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.686775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.686912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 776/1574] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.687654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.697333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:43.703520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 799/1575] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:43.704726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.715139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158556b2-8ae0-4bd9-ad6e-ef76cdc17345 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.738884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:43.759125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32489a2-3c57-4274-a980-41ee5a07f975 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.764230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.764860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.765137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.765409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.766034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.767975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.772446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.773093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.773380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.773662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.774552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.777175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.797807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 777/1576] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.798722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.799390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 800/1577] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.800203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.810508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f14c2f2-3c59-43fd-bd57-6316ff179dfb admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.866311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e904c6b4-cc3c-4699-9d3c-f8ed91de5933 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.868362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.869056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.869338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.869615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] PATH_INFO: `/v3/projects/24f1c7ef86e249609aa78b17636eae4c/users/a668b28a28714a259ea3d091a88ce597/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.871942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.872599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.872879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.873154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.873786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.875740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.885793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] RBAC: Authorizing `identity:create_grant(project_id=24f1c7ef86e249609aa78b17636eae4c, user_id=a668b28a28714a259ea3d091a88ce597, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.889865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.912998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 801/1578] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:43 2022] PUT /identity/v3/projects/24f1c7ef86e249609aa78b17636eae4c/users/a668b28a28714a259ea3d091a88ce597/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:43.913172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 778/1579] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:43.913282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.913374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:43.971613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f76736-7f4e-4948-ad00-0e42c9f0715e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.974820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884d596-9a46-40fa-a9ec-8358a7056ab6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:43.979507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:43.980274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:43.980553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:43.981174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:43.981446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:43.983459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:43.995918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:44.009299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 779/1580] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:43 2022] POST /identity/v3/projects => generated 391 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.010105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.024891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.025506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.025787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.026235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.035521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.036962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.047044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 802/1581] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:44.048066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.050932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:44.059640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dee1bbb-63cc-49e3-bd03-3877a0af8756 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.074870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006bd85c-3d8e-4bf5-a991-c7b6a4b096c2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.080135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.080835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.081143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.081378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.082048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.083125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:26:44.083125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:26:44.083125 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:26:44.084332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.109381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 780/1582] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.110207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.120901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7d637a-01e0-4f1a-add2-9b914014dd2a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.125663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.126261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.126544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.126894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.127515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.128038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.128653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.128937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.129211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.129498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.129835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.131796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.157988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 781/1583] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.159011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.165587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 803/1584] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.165587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.173009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75643cba-f7b2-413b-adf9-379d83a4947f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.238394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21ed85-ba33-402f-91a9-de95c44d71e8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.243951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.244806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.245322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.245832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.246517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.248673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.249044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d52c04-169c-4ef2-8ed1-4797a6538920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.249911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52c04-169c-4ef2-8ed1-4797a6538920 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.250394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52c04-169c-4ef2-8ed1-4797a6538920 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.250889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d52c04-169c-4ef2-8ed1-4797a6538920 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.251789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d52c04-169c-4ef2-8ed1-4797a6538920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.254061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d52c04-169c-4ef2-8ed1-4797a6538920 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.266574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 782/1585] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.268767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.269092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.269498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.293696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 804/1586] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/users => generated 287 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.294573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.304903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b024779-f2d3-45fb-ac06-bfb7b5009439 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.310752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.311441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.311933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.312218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.312945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.315032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.315174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] MFA Rules not processed for user `a668b28a28714a259ea3d091a88ce597`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:44.316278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:44.338141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 805/1587] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/users => generated 296 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.339701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.350694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28555105-ec6d-473b-a018-3f46ab787852 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.356266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.357119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.357477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.357856 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.358589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.360375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.373523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 806/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.374506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.385160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a7467-6dcf-492c-93bf-ce2cd386189a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.390064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.390823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.391033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 783/1589] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:44.391838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.395732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.396122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.396908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.398619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.405009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c34dda-f698-4df0-ad3e-dc32317d7a7e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.413375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 807/1590] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.413375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.416274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.417823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.418306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.419855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.420956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:44.421494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.424413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.425731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f489a-c631-46e0-a1ae-e1d6a7c33cf9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.433259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.434415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.434840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.435225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.436223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.438263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.451053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 808/1591] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.452352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.455532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 784/1592] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/users => generated 289 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:44.456676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.464890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b7b1ca-b062-48ce-ab0a-cbc1c6652b57 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.469551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451c4651-cd1e-4c32-8bae-01cc492ce8c3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.470031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.470778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.471174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.471550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.472293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.473976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.474422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.475132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.475483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.475823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.476535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.478211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.486831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 809/1593] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.486831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.490181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 785/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.491134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.499345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f497e90b-ee83-4379-a7c9-fcae5e228a5c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.503285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64926307-92e9-4f18-b618-7347c611b99d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.504791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61993dd-cfad-4559-89f8-fd2b1d6329d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.505401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61993dd-cfad-4559-89f8-fd2b1d6329d9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.505915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61993dd-cfad-4559-89f8-fd2b1d6329d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.506195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61993dd-cfad-4559-89f8-fd2b1d6329d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.506885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61993dd-cfad-4559-89f8-fd2b1d6329d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.508768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61993dd-cfad-4559-89f8-fd2b1d6329d9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.511992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.512699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.513042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.513384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.514094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.515877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.517466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:44.523650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 810/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.525370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a47f-ca66-415a-90d4-7443f2566886 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.525707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a47f-ca66-415a-90d4-7443f2566886 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.526575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604a47f-ca66-415a-90d4-7443f2566886 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.528221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 811/1596] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 17 23:26:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:26:44.533854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a47f-ca66-415a-90d4-7443f2566886 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.537190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 786/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.537874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.550221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc243fe-329c-482f-80be-882ec784156e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.553227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604a47f-ca66-415a-90d4-7443f2566886 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.555562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.556287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.556710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.557089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.558544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.560366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.560582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.562003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.562642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.563178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] PATH_INFO: `/v3/projects/451c0e36ddac4bb5b6e50a5f61995777/users/31b0201bf57647b1b71e0a7bc592bf3a/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.577057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 787/1598] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.578439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.585468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] RBAC: Authorizing `identity:create_grant(project_id=451c0e36ddac4bb5b6e50a5f61995777, user_id=31b0201bf57647b1b71e0a7bc592bf3a, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.589923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.592097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c78d92-6c1c-452b-8c87-ca1cc9ae0ddf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.598561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.599488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.600023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.600700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.601937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.604225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.613240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 812/1599] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:44 2022] PUT /identity/v3/projects/451c0e36ddac4bb5b6e50a5f61995777/users/31b0201bf57647b1b71e0a7bc592bf3a/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:44.614111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.623343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 788/1600] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.624568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.634888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76b5718-fb10-4d71-952d-66e09b95f9c6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.690601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ad9894-5c5b-48d9-a1f4-8be1c18b742d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.697096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.697810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.698716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419120c-89cf-4bc5-878b-b715fc375c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.698923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.699119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] PATH_INFO: `/v3/projects/dc919b3bdde8426c8fdc0648d838ae8d/users/c91217e161eb44e9afb1c39746c1deb5/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.699428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419120c-89cf-4bc5-878b-b715fc375c9f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.699657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419120c-89cf-4bc5-878b-b715fc375c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.700046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419120c-89cf-4bc5-878b-b715fc375c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.700646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419120c-89cf-4bc5-878b-b715fc375c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.702923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d419120c-89cf-4bc5-878b-b715fc375c9f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.713592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 813/1601] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.715112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.715457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.715748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.719167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc919b3bdde8426c8fdc0648d838ae8d, user_id=c91217e161eb44e9afb1c39746c1deb5, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.722517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.739155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 789/1602] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:44 2022] PUT /identity/v3/projects/dc919b3bdde8426c8fdc0648d838ae8d/users/c91217e161eb44e9afb1c39746c1deb5/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:44.740274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.768679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:44.770342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:44.818545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2fc378-07e8-4c82-8001-475b10bbb861 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.823774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cfa41-487c-4d7b-96e0-21d4f6c545f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.824675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfa41-487c-4d7b-96e0-21d4f6c545f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.824792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfa41-487c-4d7b-96e0-21d4f6c545f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.824993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cfa41-487c-4d7b-96e0-21d4f6c545f0 admin admin] PATH_INFO: `/v3/projects/3898308b39a548c2bf6ddb9ca49e4579/users/3a84d10760b342fc9fb4c794cbea2170/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.841459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cfa41-487c-4d7b-96e0-21d4f6c545f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3898308b39a548c2bf6ddb9ca49e4579, user_id=3a84d10760b342fc9fb4c794cbea2170, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.844325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cfa41-487c-4d7b-96e0-21d4f6c545f0 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.846925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 814/1603] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:44.852386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.859872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 790/1604] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:44 2022] PUT /identity/v3/projects/3898308b39a548c2bf6ddb9ca49e4579/users/3a84d10760b342fc9fb4c794cbea2170/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:44.862481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.862795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.863076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.872232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1b0f3-6753-441b-a8cf-04dd3ed9d5fa None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.892074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:44.893674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:44.895917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:44.933638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:44.945553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.946504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.947739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.947739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.949320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:44.951605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:44.966608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 815/1605] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:44.967687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.971067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 791/1606] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:44.972504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:44.981873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7658e-efd4-45d7-9a96-b3380c1992b9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.984076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c5a0e9-1bc6-44a6-a3fb-09e3034b7330 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:44.988293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.989031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.989438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.989764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] PATH_INFO: `/v3/projects/66073cf981304c9a8d10add13517d40f/users/fee875a8e68a4580bd5242ef111dfd51/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:44.990109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687cf240-4b44-459a-842c-8df7e8e64d72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:44.991223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cf240-4b44-459a-842c-8df7e8e64d72 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:44.992018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cf240-4b44-459a-842c-8df7e8e64d72 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:44.992018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687cf240-4b44-459a-842c-8df7e8e64d72 admin admin] PATH_INFO: `/v3/projects/9b8caca59d52493c95a09b516b21d514/users/8c10c73d9ffa4f849c45e77926c0b0ce/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.009686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687cf240-4b44-459a-842c-8df7e8e64d72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b8caca59d52493c95a09b516b21d514, user_id=8c10c73d9ffa4f849c45e77926c0b0ce, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.011719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66073cf981304c9a8d10add13517d40f, user_id=fee875a8e68a4580bd5242ef111dfd51, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.014034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687cf240-4b44-459a-842c-8df7e8e64d72 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.016856 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.035633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 792/1607] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:44 2022] PUT /identity/v3/projects/9b8caca59d52493c95a09b516b21d514/users/8c10c73d9ffa4f849c45e77926c0b0ce/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:45.037501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dadb-cf9b-4044-bc3a-70182c4b8a65 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.037501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dadb-cf9b-4044-bc3a-70182c4b8a65 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.037713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec5dadb-cf9b-4044-bc3a-70182c4b8a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.040621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 816/1608] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:44 2022] PUT /identity/v3/projects/66073cf981304c9a8d10add13517d40f/users/fee875a8e68a4580bd5242ef111dfd51/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:45.042230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.086932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2ec5dadb-cf9b-4044-bc3a-70182c4b8a65 None None] MFA Rules not processed for user `c91217e161eb44e9afb1c39746c1deb5`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:45.088540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2ec5dadb-cf9b-4044-bc3a-70182c4b8a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.176262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb6cc10-58aa-4a74-8efc-1d54ae567771 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:45.186894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:45.187758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.188338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.188813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.196450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 793/1609] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:45.197763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.198882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.199171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.240533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] MFA Rules not processed for user `3a84d10760b342fc9fb4c794cbea2170`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:45.240797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.275685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.278804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.289929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 817/1610] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:45.302888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.338168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 794/1611] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:45.339128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.344139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.396175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:45.410057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:45.420585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29077-4dbd-487b-8ba6-b439c6e43c95 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:45.430493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d245d-e61e-4f63-bdd5-da57744a40a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:45.431195 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d245d-e61e-4f63-bdd5-da57744a40a8 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.431485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d245d-e61e-4f63-bdd5-da57744a40a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.433190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d245d-e61e-4f63-bdd5-da57744a40a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.475064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4bd00-6a76-42b4-bf0d-0e4ad4c41a98 service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:45.486870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58783954-dfc6-4889-8db5-669ee544d850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:45.487703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783954-dfc6-4889-8db5-669ee544d850 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.487829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783954-dfc6-4889-8db5-669ee544d850 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.488084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58783954-dfc6-4889-8db5-669ee544d850 admin admin] PATH_INFO: `/v3/projects/2a9b03c12fb84d65acd5cce493048c9c/users/c7ce99c5bac948a7bccd3fdf5cb2e462/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.517019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58783954-dfc6-4889-8db5-669ee544d850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2a9b03c12fb84d65acd5cce493048c9c, user_id=c7ce99c5bac948a7bccd3fdf5cb2e462, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.519893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58783954-dfc6-4889-8db5-669ee544d850 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.535905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d245d-e61e-4f63-bdd5-da57744a40a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.537426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 818/1612] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:45 2022] PUT /identity/v3/projects/2a9b03c12fb84d65acd5cce493048c9c/users/c7ce99c5bac948a7bccd3fdf5cb2e462/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:45.539074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.539295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d245d-e61e-4f63-bdd5-da57744a40a8 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.539779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.539779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.558150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 795/1613] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:45.560470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb40e-0f67-46bf-a8a0-09cc6a8ae662 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.560833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb40e-0f67-46bf-a8a0-09cc6a8ae662 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.561189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44eb40e-0f67-46bf-a8a0-09cc6a8ae662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.566177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:45.567745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.597785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f44eb40e-0f67-46bf-a8a0-09cc6a8ae662 None None] MFA Rules not processed for user `fee875a8e68a4580bd5242ef111dfd51`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:45.599417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f44eb40e-0f67-46bf-a8a0-09cc6a8ae662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.642010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 819/1614] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:45.643100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.663523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827b4b93-8de1-41f8-801c-e55c492e2714 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:45.672762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ccf07-937a-4165-a51d-ccf40c24ca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:45.674247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ccf07-937a-4165-a51d-ccf40c24ca92 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.674951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ccf07-937a-4165-a51d-ccf40c24ca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.675334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ccf07-937a-4165-a51d-ccf40c24ca92 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.676069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ccf07-937a-4165-a51d-ccf40c24ca92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.681313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ccf07-937a-4165-a51d-ccf40c24ca92 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.716366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 796/1615] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:45.716366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c51d2a-9fd7-496d-9bc9-233d91186ee3 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.716366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c51d2a-9fd7-496d-9bc9-233d91186ee3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.716366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c51d2a-9fd7-496d-9bc9-233d91186ee3 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.719085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 797/1616] 10.222.0.39 () {54 vars in 962 bytes} [Wed Aug 17 23:26:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:26:45.721275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65abaf-0c56-4a5c-a83a-0878601d50a4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.721874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65abaf-0c56-4a5c-a83a-0878601d50a4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.722278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65abaf-0c56-4a5c-a83a-0878601d50a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.724467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 820/1617] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:45.726636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7ddb-6155-4d62-856e-128898c1c66c None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.726999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7ddb-6155-4d62-856e-128898c1c66c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.727416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37c7ddb-6155-4d62-856e-128898c1c66c None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.730364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 821/1618] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 17 23:26:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:26:45.731632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7ddb-6155-4d62-856e-128898c1c66c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.755920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0e65abaf-0c56-4a5c-a83a-0878601d50a4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:45.757264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0e65abaf-0c56-4a5c-a83a-0878601d50a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.846217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 798/1619] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:45.848500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3859-e94d-4540-a0ff-2fe9175715ec None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.849072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3859-e94d-4540-a0ff-2fe9175715ec None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.856057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3859-e94d-4540-a0ff-2fe9175715ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.857947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37c7ddb-6155-4d62-856e-128898c1c66c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:45.864278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:45.865395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.865786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.866178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.885383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-805c3859-e94d-4540-a0ff-2fe9175715ec None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:45.885876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.887986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-805c3859-e94d-4540-a0ff-2fe9175715ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:45.888912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.907303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:45.922145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 822/1620] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:45.922975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.944857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e792bbb6-49d0-4f7c-81d9-8bdbf29923a3 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:45.956604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:45.957493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.957632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.957813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:45.958496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:45.960610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:45.991352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 799/1621] 10.222.0.39 () {58 vars in 1059 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:45.992988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 823/1622] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/users => generated 289 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:45.993188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:45.993485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:45.993822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:45.993940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.019005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:46.020402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:46.023159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5c08ff-6490-42ec-af7b-6bf5358089fe admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.027394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.028017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.028304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.028583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.047395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.048776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 800/1623] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:26:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:46.048931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.049757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.062188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7363e447-90f9-4e3b-b967-22579d4fca01 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.063040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 824/1624] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:46.064007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.067776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.068600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.068894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.069170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.069826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.071758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.074870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:46.080303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c81de3-fb95-4f62-91ca-16634582f21f service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.090880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.091656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.091947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.092228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.093441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 801/1625] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:46.096503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.232636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.232636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.245744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 825/1626] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:46 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:46.248537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.288567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b66b8-c48e-431f-b0ec-6c21c35efc75 service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.305764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.306927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.307547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.308222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] PATH_INFO: `/v3/projects/de2022d0d0814cd1814239c25ff058e3/users/0793c3f224094d339fe3fa76c4c2275b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.308344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcf5de7-21a7-4ea2-aa3d-17b379d03c57 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.312680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.313316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.313602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.313880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.332355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.333843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.357151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2022d0d0814cd1814239c25ff058e3, user_id=0793c3f224094d339fe3fa76c4c2275b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.359850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.382121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 802/1627] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:46.394585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 826/1628] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:46 2022] PUT /identity/v3/projects/de2022d0d0814cd1814239c25ff058e3/users/0793c3f224094d339fe3fa76c4c2275b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:46.398607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.425439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9c5248-9283-4a99-90db-ba6a1636da04 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.517994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36552295-7db3-447f-baca-705f8497436b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.519569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552295-7db3-447f-baca-705f8497436b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.520168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552295-7db3-447f-baca-705f8497436b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.520461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36552295-7db3-447f-baca-705f8497436b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.521323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36552295-7db3-447f-baca-705f8497436b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.523500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36552295-7db3-447f-baca-705f8497436b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.539775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 803/1629] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:46.543915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.563400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d8425-290e-4559-9505-db17989f69c4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.579690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f16798-ca7a-47a2-bdd1-2af5cc4b9f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.581686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16798-ca7a-47a2-bdd1-2af5cc4b9f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.581985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16798-ca7a-47a2-bdd1-2af5cc4b9f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.582268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f16798-ca7a-47a2-bdd1-2af5cc4b9f9a admin admin] PATH_INFO: `/v3/projects/de2022d0d0814cd1814239c25ff058e3/users/0793c3f224094d339fe3fa76c4c2275b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.586100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f16798-ca7a-47a2-bdd1-2af5cc4b9f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2022d0d0814cd1814239c25ff058e3, user_id=0793c3f224094d339fe3fa76c4c2275b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.591094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f16798-ca7a-47a2-bdd1-2af5cc4b9f9a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.615701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209c0ec-3143-40ab-8714-09e77b5b9aa2 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.616047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209c0ec-3143-40ab-8714-09e77b5b9aa2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.616620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209c0ec-3143-40ab-8714-09e77b5b9aa2 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.618871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 804/1630] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 17 23:26:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:26:46.621324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 827/1631] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:46 2022] PUT /identity/v3/projects/de2022d0d0814cd1814239c25ff058e3/users/0793c3f224094d339fe3fa76c4c2275b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:26:46.631486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.631881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.632345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.638221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.638598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.638996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.674986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:46.676509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:46.694053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] MFA Rules not processed for user `0793c3f224094d339fe3fa76c4c2275b`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:46.695332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:46.717263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:46.787359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 805/1632] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:46.801595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:46.872023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 828/1633] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:26:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:46.902828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c5379-136c-4325-9c26-11ad21fe49b6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:46.907042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:46.907748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:46.908221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:46.908354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:46.924790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:46.928381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:46.971145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 806/1634] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:26:47.035908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:47.050750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6534990-c749-489e-a61f-20a64eae72c9 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:47.061254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:47.062909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:47.064653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:47.066300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:47.103499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:47.109833 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:47.143274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 829/1635] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:47.546161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:47.552308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:47.564005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9007e4-308d-4daa-bec2-76e62460e0ad service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:47.569887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83734c1e-a9f4-44c4-a157-09683d33c1b5 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:47.573037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:47.574665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:47.575242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:47.575648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:47.596716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c12be5-ed3d-44f1-a7a6-9da76e615c7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:47.597358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c12be5-ed3d-44f1-a7a6-9da76e615c7b service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:47.597646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c12be5-ed3d-44f1-a7a6-9da76e615c7b service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:47.597956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c12be5-ed3d-44f1-a7a6-9da76e615c7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:47.711801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:47.733069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:47.736983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:47.756975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c12be5-ed3d-44f1-a7a6-9da76e615c7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:47.762384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c12be5-ed3d-44f1-a7a6-9da76e615c7b service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:47.769349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 807/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:47.809741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 830/1637] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:48.452631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:48.585352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:48.596399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd33ed5-0b65-484a-94c9-ef2dd57e5e12 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:48.609971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:48.610641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:48.610968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:48.611246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] PATH_INFO: `/v3/users/fee875a8e68a4580bd5242ef111dfd51` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:48.617119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee875a8e68a4580bd5242ef111dfd51)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:48.619411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:48.690843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee875a8e68a4580bd5242ef111dfd51'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:48.716724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee875a8e68a4580bd5242ef111dfd51'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:48.733822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee875a8e68a4580bd5242ef111dfd51'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:48.734406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee875a8e68a4580bd5242ef111dfd51'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:48.744005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee875a8e68a4580bd5242ef111dfd51'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:48.759111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 808/1638] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:26:48 2022] DELETE /identity/v3/users/fee875a8e68a4580bd5242ef111dfd51 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:48.765021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:48.765924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:48.766371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:48.802289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:48.805638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:48.964007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 831/1639] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:49.325264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:49.327129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:49.468281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ec0645-1f9d-4738-9b48-9dc4c3a02f90 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:49.473297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:49.473931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:49.507723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:49.507723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:49.509817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:49.513051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:49.539979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 809/1640] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:50.130693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:50.132743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:50.153556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a2fc4-5d1d-4eff-a0ca-4441d09ac1b2 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:50.173042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:50.174057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.174490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.175108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] PATH_INFO: `/v3/users/a668b28a28714a259ea3d091a88ce597` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.176807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a668b28a28714a259ea3d091a88ce597)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:50.178019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: WARNING py.warnings [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:26:50.178019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: warnings.warn(msg) Aug 17 23:26:50.178019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: Aug 17 23:26:50.179993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:50.295428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:50.297052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:50.338921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4cde9-1344-4072-beb8-f117be982261 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:50.347901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a668b28a28714a259ea3d091a88ce597'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.349029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a668b28a28714a259ea3d091a88ce597'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.359661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:50.360322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.360612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.360891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] PATH_INFO: `/v3/projects/66073cf981304c9a8d10add13517d40f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.362065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=66073cf981304c9a8d10add13517d40f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:50.363134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: WARNING py.warnings [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 17 23:26:50.363134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: warnings.warn(msg) Aug 17 23:26:50.363134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: Aug 17 23:26:50.364338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:50.389285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a668b28a28714a259ea3d091a88ce597'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.420796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a668b28a28714a259ea3d091a88ce597'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.440134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-7fe5c8f3-b1f8-4112-8492-63d00bc6583b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a668b28a28714a259ea3d091a88ce597'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.449108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 832/1641] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:26:50 2022] DELETE /identity/v3/users/a668b28a28714a259ea3d091a88ce597 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:50.456519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.458437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.458971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.487831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66073cf981304c9a8d10add13517d40f', 'request_id': 'req-22656286-2a71-4bb4-b3fb-675e2262e2d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.498100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66073cf981304c9a8d10add13517d40f', 'request_id': 'req-22656286-2a71-4bb4-b3fb-675e2262e2d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.514212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66073cf981304c9a8d10add13517d40f', 'request_id': 'req-22656286-2a71-4bb4-b3fb-675e2262e2d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.526476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:50.529151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:50.547950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:50.552662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] The token cache is being invalidate because project 66073cf981304c9a8d10add13517d40f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:26:50.553711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.554932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-22656286-2a71-4bb4-b3fb-675e2262e2d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:50.557557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 810/1642] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:26:50 2022] DELETE /identity/v3/projects/66073cf981304c9a8d10add13517d40f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:50.562264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c3c2-8de5-443a-9c92-fae74baa8271 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.562738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c3c2-8de5-443a-9c92-fae74baa8271 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.563188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb2c3c2-8de5-443a-9c92-fae74baa8271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.608272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-bcb2c3c2-8de5-443a-9c92-fae74baa8271 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:50.609879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-bcb2c3c2-8de5-443a-9c92-fae74baa8271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:50.624743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:50.652272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 833/1643] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:50.679395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:50.680883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:50.768830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 811/1644] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:50.777886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.778270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.778730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.819989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8976014a-c00e-4488-9ab6-2978fd5b0684 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:50.823625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:50.824097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:50.824734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.824850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:50.825019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.825301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.835413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 812/1645] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:50.839427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:50.848527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:50.849998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:50.866513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7297b5b-833c-49e2-a230-e9eb4211921f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:50.881998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 834/1646] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:50.883062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:50.884118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.884412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.886023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.886807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:50.887126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:50.891769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:50.928214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 813/1647] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:26:50.933001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:50.946968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c46f39a-8762-4926-b1de-dcb3c79193e2 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:50.955671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:50.956665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:50.957174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:50.957614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:50.958432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:50.961286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:51.004074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 835/1648] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:50 2022] POST /identity/v3/projects => generated 365 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:51.009081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:51.030628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7455c054-1d3a-4fee-84c2-80b386da97dd admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:51.139428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:51.140995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:51.141882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:51.142359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:51.144429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:51.148229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:51.254223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 814/1649] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:51 2022] POST /identity/v3/users => generated 283 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:51.256357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:51.271355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fdc25c-833f-4f93-a7cb-ba3bba359d6c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:51.282674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:51.294287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:51.294287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:51.294287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:51.294966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:51.297633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:51.360849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 836/1650] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:51.362593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:51.388675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cefe17-cb51-4449-a4ec-e07ac2ef36f8 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:51.408176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5ed991-2110-49b4-a191-81b3c9e7fd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:51.408176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed991-2110-49b4-a191-81b3c9e7fd72 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:51.408629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed991-2110-49b4-a191-81b3c9e7fd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:51.408629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5ed991-2110-49b4-a191-81b3c9e7fd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:51.409390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ed991-2110-49b4-a191-81b3c9e7fd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:51.411114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5ed991-2110-49b4-a191-81b3c9e7fd72 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:51.429083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:51.431121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 815/1651] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:51.444375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033da29-9913-451f-8723-0a914e9cefd9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:51.458505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:51.459246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:51.459591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:51.460145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] PATH_INFO: `/v3/projects/173592a1b0a74ae6a248f31af62e5a6b/users/707f5fdda5184f098abb5fd856a21b1c/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:51.505781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=173592a1b0a74ae6a248f31af62e5a6b, user_id=707f5fdda5184f098abb5fd856a21b1c, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:51.509110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:51.553062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 837/1652] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:51 2022] PUT /identity/v3/projects/173592a1b0a74ae6a248f31af62e5a6b/users/707f5fdda5184f098abb5fd856a21b1c/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:51.555902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:51.556382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:51.556806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:51.670016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] MFA Rules not processed for user `707f5fdda5184f098abb5fd856a21b1c`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:51.671464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:51.872370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:51.924222 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 816/1653] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:51.925350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:52.092111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72e867e-a75f-4f5d-85bf-799e3507d060 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:52.106520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:52.107300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:52.107766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:52.108141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:52.109115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:52.116062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:52.196660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:52.197379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 838/1654] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:51 2022] POST /identity/v3/projects => generated 365 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:52.226487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61478a3-0ef6-4479-b9cb-90f63278303e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:52.408253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:52.408855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:52.409131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:52.409417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:52.410061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:52.427339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:52.510973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 817/1655] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:52 2022] POST /identity/v3/users => generated 289 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:52.511966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:52.537350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f2d25-2d36-4683-a837-a60b209c7ca0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:52.553857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:52.571600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:52.573699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:52.578432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:52.581341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:52.583455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:52.690332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 839/1656] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:52.694468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:52.721438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6553e8-e52a-433d-a7a7-6d97f9f32dc3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:52.749847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:52.750844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:52.751323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:52.751751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] PATH_INFO: `/v3/projects/1633684c6344412299219059d105dca5/users/f0689ddef8fa45d79720a7ab86e22172/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:52.815266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1633684c6344412299219059d105dca5, user_id=f0689ddef8fa45d79720a7ab86e22172, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:52.818967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:52.854887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 818/1657] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:52 2022] PUT /identity/v3/projects/1633684c6344412299219059d105dca5/users/f0689ddef8fa45d79720a7ab86e22172/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:52.859320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:52.886812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7ce5db-b3e1-4d3e-91ff-311c04b5fa94 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:52.931728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:53.055863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142b1c7-3c0b-438a-bf4c-1b8f7c6e34b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:53.056713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b1c7-3c0b-438a-bf4c-1b8f7c6e34b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:53.058374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b1c7-3c0b-438a-bf4c-1b8f7c6e34b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:53.059525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142b1c7-3c0b-438a-bf4c-1b8f7c6e34b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:53.064644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b1c7-3c0b-438a-bf4c-1b8f7c6e34b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:53.068357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8142b1c7-3c0b-438a-bf4c-1b8f7c6e34b6 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:53.091001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 840/1658] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:52 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:53.094987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:53.120369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82662756-f26c-4dec-ba17-f519f4bbb16f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:53.141652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:53.142114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:53.142401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:53.143199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] PATH_INFO: `/v3/projects/1633684c6344412299219059d105dca5/users/f0689ddef8fa45d79720a7ab86e22172/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:53.151672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1633684c6344412299219059d105dca5, user_id=f0689ddef8fa45d79720a7ab86e22172, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:53.155095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:53.195428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 819/1659] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:53 2022] PUT /identity/v3/projects/1633684c6344412299219059d105dca5/users/f0689ddef8fa45d79720a7ab86e22172/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:53.211521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:53.211842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:53.212247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:53.340731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] MFA Rules not processed for user `f0689ddef8fa45d79720a7ab86e22172`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:53.341990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:53.497549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:53.500933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:53.640009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 841/1660] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:53.694352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:53.696507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:53.883930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58e5ed-f25b-429c-980a-7d2ec5cf05a8 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:53.889337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:53.890346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:53.890863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:53.891283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:53.913795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:53.918052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:53.941256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44868059-8348-4b1f-bb43-8834532263f5 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:53.954422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 842/1661] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:53 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:26:53.962909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:53.964077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:53.964882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:53.968097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] PATH_INFO: `/v3/projects/24f1c7ef86e249609aa78b17636eae4c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:53.971735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24f1c7ef86e249609aa78b17636eae4c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:53.982226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:54.160984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:54.162922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24f1c7ef86e249609aa78b17636eae4c', 'request_id': 'req-c04967ca-403c-4264-a472-e04cf8976593'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:54.167814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:54.173498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24f1c7ef86e249609aa78b17636eae4c', 'request_id': 'req-c04967ca-403c-4264-a472-e04cf8976593'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:54.192512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24f1c7ef86e249609aa78b17636eae4c', 'request_id': 'req-c04967ca-403c-4264-a472-e04cf8976593'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:54.212438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceac9e3-6344-44a0-9241-e4c3e6e74e2c service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:54.236988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] The token cache is being invalidate because project 24f1c7ef86e249609aa78b17636eae4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:26:54.237298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:54.242621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c04967ca-403c-4264-a472-e04cf8976593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:54.249294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 820/1662] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:26:53 2022] DELETE /identity/v3/projects/24f1c7ef86e249609aa78b17636eae4c => generated 0 bytes in 752 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:54.253958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fddd-778c-4b2c-b3dc-e64e77c67c23 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:54.254244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fddd-778c-4b2c-b3dc-e64e77c67c23 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:54.254528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4981fddd-778c-4b2c-b3dc-e64e77c67c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:54.313248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-4981fddd-778c-4b2c-b3dc-e64e77c67c23 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:54.317506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4981fddd-778c-4b2c-b3dc-e64e77c67c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:54.358191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:54.396258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:54.397953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:54.400649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:54.401201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:54.408714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:54.537646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 821/1663] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:54.548909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:54.549203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:54.549481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:54.582753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:54.588621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:54.618139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 843/1664] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:26:54.639444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:54.640767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:54.653011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 822/1665] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:54.657581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:54.674999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027162-3315-47a1-a36a-cc9c5db313e9 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:54.700828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:54.701575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:54.701963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:54.702344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:54.703206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:54.703731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:54.721506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:54.760601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 844/1666] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:54.768035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:54.780240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0907a0f3-5aeb-4d1b-b066-7c5a710808db None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:54.795147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:54.796885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:54.797325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:54.797764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:54.799044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:54.801617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:54.936384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 823/1667] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:54 2022] POST /identity/v3/projects => generated 377 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:54.941653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:54.966227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:54.966426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf55ed-8e99-412f-8d0b-3ff6d5cb4a2d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:54.973215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:55.140452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19416e0d-2759-45b6-98f6-386285294753 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:55.148413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:55.148711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:55.149707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.150058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.150400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.151621 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:55.151831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.152248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.154325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] PATH_INFO: `/v3/users/3a84d10760b342fc9fb4c794cbea2170` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.157829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:55.159514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a84d10760b342fc9fb4c794cbea2170)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:55.165818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:55.215522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 845/1668] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:54 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:55.218195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:55.250069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3881ea37-136f-4033-8fad-7c7b051efe0e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:55.264681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:55.267147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.267574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.268787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.270073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:55.273715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:55.299183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:55.302440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a84d10760b342fc9fb4c794cbea2170'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:55.303550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 846/1669] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:55.308557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:55.322236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dd53f7-dea7-4d95-b4c0-4576e4b91bbc admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:55.335002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:55.335840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.336563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.337647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.338604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:55.340890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:55.361533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a84d10760b342fc9fb4c794cbea2170'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:55.378420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 847/1670] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:55 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:55.380216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:55.382918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a84d10760b342fc9fb4c794cbea2170'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:55.383595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a84d10760b342fc9fb4c794cbea2170'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:55.395163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:55.409771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b861e73c-1e92-493b-94bd-f3bf425f7772 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a84d10760b342fc9fb4c794cbea2170'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:55.442107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 824/1671] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:26:54 2022] DELETE /identity/v3/users/3a84d10760b342fc9fb4c794cbea2170 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:55.448960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4db3c-c2f1-4a56-9f57-66b7c882ae60 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.449259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4db3c-c2f1-4a56-9f57-66b7c882ae60 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.449564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec4db3c-c2f1-4a56-9f57-66b7c882ae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.452019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd209972-70b1-4ec8-a161-5e258482fbe6 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:55.491848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-dec4db3c-c2f1-4a56-9f57-66b7c882ae60 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:55.493115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dec4db3c-c2f1-4a56-9f57-66b7c882ae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:55.623375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:55.663041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:55.664448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.664928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.665350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] PATH_INFO: `/v3/projects/74b1b368b5034d0a83cb6495f65466d5/users/40a8dc2209c3411c9334547e0e0e7cc7/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.687473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 825/1672] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:55.701269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74b1b368b5034d0a83cb6495f65466d5, user_id=40a8dc2209c3411c9334547e0e0e7cc7, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:55.704716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:55.735586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 848/1673] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:55 2022] PUT /identity/v3/projects/74b1b368b5034d0a83cb6495f65466d5/users/40a8dc2209c3411c9334547e0e0e7cc7/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:55.747097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:55.747429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:55.747720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:55.810099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] MFA Rules not processed for user `40a8dc2209c3411c9334547e0e0e7cc7`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:55.812612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:55.829857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:55.833702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:56.054888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 826/1674] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:56.056300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:56.065093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cec1c8-711e-46cc-865c-69f86bfcecf0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:56.078775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:56.079518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.080696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.080987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.162511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:56.187043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a14cfe-74c5-448f-8bb5-cb436eec50c4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:56.200860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:56.201516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.201804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.202355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.202937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:56.207521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:56.213989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:56.217492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:56.231414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 849/1675] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:56.268425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 827/1676] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:56 2022] POST /identity/v3/projects => generated 375 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:56.272411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:56.292306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca86e3-4292-49e1-a6a6-675e6aa20c94 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:56.419350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:56.420090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.420522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.420935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.421687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:56.425018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:56.471797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 850/1677] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:56 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:56.474677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:56.490677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a20b9e-af03-4410-91ac-ac8375dacd54 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:56.505118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73cae98-4ebe-4545-b3ee-d2ea57dfd2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:56.508927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cae98-4ebe-4545-b3ee-d2ea57dfd2e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.509408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cae98-4ebe-4545-b3ee-d2ea57dfd2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.509923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73cae98-4ebe-4545-b3ee-d2ea57dfd2e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.519992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cae98-4ebe-4545-b3ee-d2ea57dfd2e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:56.521871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73cae98-4ebe-4545-b3ee-d2ea57dfd2e4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:56.548089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 828/1678] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:56.552818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:56.590150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ef8b91-6947-4cbb-9ab0-1fb2e221f29a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:56.616255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:56.617230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.617653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.618447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] PATH_INFO: `/v3/projects/b6213e314c364e2a83929af14f731bbe/users/a57b26307b704fbf8643af72da3bebe9/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.625126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.625720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.626664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.641555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:56.665672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6213e314c364e2a83929af14f731bbe, user_id=a57b26307b704fbf8643af72da3bebe9, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:56.675090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:56.688414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] MFA Rules not processed for user `c7e73f3bfbcd41b29dc41bbbd218d413`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:56.691319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:56.715889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 851/1679] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:56 2022] PUT /identity/v3/projects/b6213e314c364e2a83929af14f731bbe/users/a57b26307b704fbf8643af72da3bebe9/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:56.719333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:56.871820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 829/1680] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:56 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:26:56.908294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dc2c8-3e1e-4390-8b14-6b708da2060f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:56.910001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:56.913011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:56.923302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:56.923933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:56.924217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:56.924488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:56.925210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:56.934838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:56.973777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 852/1681] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:56 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:56.974734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:57.006612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c786dc-461f-4ed3-b2da-870c358a83c6 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:57.035539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dc9a59-8075-45ac-bc48-985d79ea1522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:57.036273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc9a59-8075-45ac-bc48-985d79ea1522 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:57.036614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc9a59-8075-45ac-bc48-985d79ea1522 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:57.036779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dc9a59-8075-45ac-bc48-985d79ea1522 admin admin] PATH_INFO: `/v3/projects/b6213e314c364e2a83929af14f731bbe/users/a57b26307b704fbf8643af72da3bebe9/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:57.043053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc9a59-8075-45ac-bc48-985d79ea1522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6213e314c364e2a83929af14f731bbe, user_id=a57b26307b704fbf8643af72da3bebe9, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:57.046908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dc9a59-8075-45ac-bc48-985d79ea1522 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:57.096848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 853/1682] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:56 2022] PUT /identity/v3/projects/b6213e314c364e2a83929af14f731bbe/users/a57b26307b704fbf8643af72da3bebe9/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:57.117500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:57.117772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:57.118053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:57.135615 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd135-dde7-488e-9df1-12af758fbc6a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:57.196904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] MFA Rules not processed for user `a57b26307b704fbf8643af72da3bebe9`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:57.200272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:57.344950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:57.389067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:57.389856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:57.390196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:57.390590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:57.476940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 854/1683] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:57.487749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:57.494196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:57.600476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:57.600917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5377a6-3f86-4338-9ce3-7dff36c9dd27 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:57.602550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:57.607767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743a9b63-fe6a-4f8a-9baf-79b25705c41c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:57.608541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a9b63-fe6a-4f8a-9baf-79b25705c41c service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:57.608922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a9b63-fe6a-4f8a-9baf-79b25705c41c service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:57.609351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743a9b63-fe6a-4f8a-9baf-79b25705c41c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:57.624677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:57.645338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 830/1684] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 736 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:57.667272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:57.670612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:57.763118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a9b63-fe6a-4f8a-9baf-79b25705c41c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:57.767498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743a9b63-fe6a-4f8a-9baf-79b25705c41c service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:57.793464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 855/1685] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:57.836302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d143c-6a4d-462e-a959-44217cffff32 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:57.847453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:57.847980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:57.848265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:57.848599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] PATH_INFO: `/v3/users/c91217e161eb44e9afb1c39746c1deb5` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:57.856149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c91217e161eb44e9afb1c39746c1deb5)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:57.858149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:57.968004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c91217e161eb44e9afb1c39746c1deb5'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.000227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c91217e161eb44e9afb1c39746c1deb5'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.013310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c91217e161eb44e9afb1c39746c1deb5'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.014548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c91217e161eb44e9afb1c39746c1deb5'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.033936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c91217e161eb44e9afb1c39746c1deb5'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.046378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 831/1686] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:26:57 2022] DELETE /identity/v3/users/c91217e161eb44e9afb1c39746c1deb5 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:26:58.051839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:58.052632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:58.053111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:58.100367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:58.101868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:58.268387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 856/1687] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:58.294121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:58.295881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:58.321594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:58.334892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:58.379891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e9de47-2c6d-4eed-8543-d95e77c0d284 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:58.401578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:58.402571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:58.403033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:58.403470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] PATH_INFO: `/v3/projects/3898308b39a548c2bf6ddb9ca49e4579` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:58.407518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3898308b39a548c2bf6ddb9ca49e4579)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:58.409529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:58.440291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:58.591448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17f6fc2-d8bb-4723-a3e9-9aecfc49e10f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:58.592388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3898308b39a548c2bf6ddb9ca49e4579', 'request_id': 'req-da5f0475-488b-4173-b525-7524e8d0edd3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.619784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3898308b39a548c2bf6ddb9ca49e4579', 'request_id': 'req-da5f0475-488b-4173-b525-7524e8d0edd3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.636561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3898308b39a548c2bf6ddb9ca49e4579', 'request_id': 'req-da5f0475-488b-4173-b525-7524e8d0edd3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.693318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] The token cache is being invalidate because project 3898308b39a548c2bf6ddb9ca49e4579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:26:58.693626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.694506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-da5f0475-488b-4173-b525-7524e8d0edd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:26:58.700106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 832/1688] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:26:58 2022] DELETE /identity/v3/projects/3898308b39a548c2bf6ddb9ca49e4579 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:58.705786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98cb74-1846-4b61-9f7c-7696705fcfe5 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:58.706309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98cb74-1846-4b61-9f7c-7696705fcfe5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:58.706827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b98cb74-1846-4b61-9f7c-7696705fcfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:58.769427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:58.770034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:58.770267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:58.770553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:58.772432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:58.780086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8b98cb74-1846-4b61-9f7c-7696705fcfe5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:58.793778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8b98cb74-1846-4b61-9f7c-7696705fcfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:58.814742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:26:58.939738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:58.946038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 833/1689] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:58.948635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:58.953954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:58.954377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:58.955251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:58.968905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 857/1690] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:26:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:26:59.011748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:59.014650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:26:59.051964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 834/1691] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:26:59.058222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:59.073780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aaf32c6-d01c-4b15-b978-ba05ad32fd03 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:59.099003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:59.099700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.100447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.100589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.102475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:26:59.102933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:59.108515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:59.142772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 858/1692] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:26:59.143887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:59.156961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbc35d8-18c9-4adf-8d58-525bbe205371 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:59.168244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:59.168878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.169212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.169493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.173671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:59.176790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:59.253298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 835/1693] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:26:59 2022] POST /identity/v3/projects => generated 371 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:59.259390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:59.280304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b3a0b-d2d5-4efa-8407-abfa0b282555 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:59.476683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:59.477350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.477644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.477926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.478606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:59.492903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:59.576553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:59.585124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 859/1694] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:26:59 2022] POST /identity/v3/users => generated 286 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:26:59.606596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f1e6c0-fe2d-4328-b968-120dd212fb33 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:59.621493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:59.623737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.624045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.624378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.625464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:59.628594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:59.664774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:59.675886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 836/1695] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:59.682569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397f3fb-d7e9-4231-8082-6a9ce6f23fde admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:59.696810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4aeb376-42ea-4aae-a773-337cb5694d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:59.702357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeb376-42ea-4aae-a773-337cb5694d01 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.702806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeb376-42ea-4aae-a773-337cb5694d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.704403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4aeb376-42ea-4aae-a773-337cb5694d01 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.705185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeb376-42ea-4aae-a773-337cb5694d01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:59.709496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4aeb376-42ea-4aae-a773-337cb5694d01 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:59.739821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 860/1696] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:26:59.743102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:26:59.759674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2cf560-863b-482b-8421-d69c195aff3c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:26:59.771486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:26:59.774023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.775885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.776196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] PATH_INFO: `/v3/projects/6a884b0121dd4eeb874b9dd85b55c053/users/a86bfa213a8c40b486c502664c806752/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.815216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a884b0121dd4eeb874b9dd85b55c053, user_id=a86bfa213a8c40b486c502664c806752, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:26:59.818395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:26:59.845831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 837/1697] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:26:59 2022] PUT /identity/v3/projects/6a884b0121dd4eeb874b9dd85b55c053/users/a86bfa213a8c40b486c502664c806752/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:26:59.858357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:26:59.858928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:26:59.859017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:26:59.941657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] MFA Rules not processed for user `a86bfa213a8c40b486c502664c806752`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:26:59.944696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:00.214358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 861/1698] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:26:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 357 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:00.219665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:00.341284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:00.413094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9aa7ea-8f6b-4f61-aa19-0d0cec9c70dc admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:00.431117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:00.431712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:00.432077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:00.434431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:00.435212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:00.439319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:00.504845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:00.511570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 838/1699] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:00 2022] POST /identity/v3/projects => generated 373 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:00.529434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc2df3-7ae2-44c5-b9c1-b47100354c27 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:00.569848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:00.694116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:00.694818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:00.695110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:00.695397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:00.696064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:00.698212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:00.757051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 862/1700] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:00 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:00.761182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:00.782963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08818cc3-aa95-478c-b3bc-8d68ef6314e3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:00.805549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:00.807156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:00.807978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:00.811298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:00.812783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:00.815684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:00.834345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 839/1701] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:00.838880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:00.854202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0143a7c-095a-40b5-aea4-645c700cc7bd admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:00.872830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:00.875899 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:00.876353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:00.876938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] PATH_INFO: `/v3/projects/19e4de9dc63f4e77904e434999666f21/users/ff0829ae7ef043fc8575d021688e9add/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:00.905897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e4de9dc63f4e77904e434999666f21, user_id=ff0829ae7ef043fc8575d021688e9add, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:00.912888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:00.943831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 863/1702] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:00 2022] PUT /identity/v3/projects/19e4de9dc63f4e77904e434999666f21/users/ff0829ae7ef043fc8575d021688e9add/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:00.949830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:00.965419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55310e7e-601d-4e19-87f9-c4d961584569 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:01.078588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffdaa1-17ed-4d6d-85ca-4224e3383c30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:01.079258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdaa1-17ed-4d6d-85ca-4224e3383c30 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.079543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdaa1-17ed-4d6d-85ca-4224e3383c30 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.079818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffdaa1-17ed-4d6d-85ca-4224e3383c30 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.080614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffdaa1-17ed-4d6d-85ca-4224e3383c30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:01.082317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffdaa1-17ed-4d6d-85ca-4224e3383c30 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:01.115832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:01.116911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 840/1703] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:01.135303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdf59-508e-4fdb-a66d-e3c6fb8ac23a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.135804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdf59-508e-4fdb-a66d-e3c6fb8ac23a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.136193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8bdf59-508e-4fdb-a66d-e3c6fb8ac23a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.140259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb6af10-681f-4eb0-b5cc-44a020438f1d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:01.155835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:01.156135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.158855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.159174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] PATH_INFO: `/v3/projects/19e4de9dc63f4e77904e434999666f21/users/ff0829ae7ef043fc8575d021688e9add/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.168808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] RBAC: Authorizing `identity:create_grant(project_id=19e4de9dc63f4e77904e434999666f21, user_id=ff0829ae7ef043fc8575d021688e9add, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:01.175818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:01.183590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7a8bdf59-508e-4fdb-a66d-e3c6fb8ac23a None None] MFA Rules not processed for user `8c10c73d9ffa4f849c45e77926c0b0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:01.185160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7a8bdf59-508e-4fdb-a66d-e3c6fb8ac23a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.210892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 864/1704] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:01 2022] PUT /identity/v3/projects/19e4de9dc63f4e77904e434999666f21/users/ff0829ae7ef043fc8575d021688e9add/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:01.220452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:01.230313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.404706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 841/1705] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:01.409528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.409836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.410287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.417951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4318deb5-1a77-4fa9-835c-a06c392d694c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:01.428289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:01.429886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.431343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.432172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.438257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.490516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] MFA Rules not processed for user `ff0829ae7ef043fc8575d021688e9add`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:01.491803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.538861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:01.605246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:01.606837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea54200b-8d55-4afd-ac18-5afe8b1b6fba service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:01.628415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 865/1706] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:01 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:01.630555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.630880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.631160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.673782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] MFA Rules not processed for user `8c10c73d9ffa4f849c45e77926c0b0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:01.681114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 842/1707] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:01.687392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.707572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:01.727088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:01.731665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.793820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7ff19f-d151-4e25-99b8-4d80ca1aeded None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:01.806171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:01.809838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:01.810797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:01.811094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:01.851439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:01.859217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:01.872568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 866/1708] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:01.873747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:01.882652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:01.910921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 843/1709] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:01.912352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:01.921839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:02.085468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2186e41-315b-47dc-9b36-84785b1eccda None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:02.102967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:02.104424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:02.107476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:02.107941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] PATH_INFO: `/v3/projects/dc919b3bdde8426c8fdc0648d838ae8d` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:02.110557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc919b3bdde8426c8fdc0648d838ae8d)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:02.126788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:02.196627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0eaee-b18c-4067-bf09-f136c9a68efd service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:02.215054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:02.216520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:02.218092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:02.219364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:02.240568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:02.246237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:02.272427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 844/1710] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:02.275594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:02.277757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc919b3bdde8426c8fdc0648d838ae8d', 'request_id': 'req-0ca85b40-ec21-41b1-9339-6ef591d05b70'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:02.295462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f65b5-5278-46f2-b38e-296b00b55bea service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:02.298925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc919b3bdde8426c8fdc0648d838ae8d', 'request_id': 'req-0ca85b40-ec21-41b1-9339-6ef591d05b70'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:02.332191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc919b3bdde8426c8fdc0648d838ae8d', 'request_id': 'req-0ca85b40-ec21-41b1-9339-6ef591d05b70'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:02.375503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] The token cache is being invalidate because project dc919b3bdde8426c8fdc0648d838ae8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:02.381782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:02.386794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:02.391667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 867/1711] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:01 2022] DELETE /identity/v3/projects/dc919b3bdde8426c8fdc0648d838ae8d => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:02.393540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:02.399432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:02.453340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:02.453977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:02.454263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:02.454540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:02.459976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:02.584939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:02.598626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:02.635819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:02.645001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:02.661469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca85b40-ec21-41b1-9339-6ef591d05b70 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:02.681159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:02.682319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 845/1712] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:02.683687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:02.687161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:02.694439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:02.694813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] PATH_INFO: `/v3/users/707f5fdda5184f098abb5fd856a21b1c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:02.703264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:02.704865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] RBAC: Authorizing `identity:delete_user(user_id=707f5fdda5184f098abb5fd856a21b1c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:02.719996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:02.772232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91683455-06cb-4b4a-b82c-da762022070f service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:02.790992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:02.795714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:02.799566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:02.800082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] PATH_INFO: `/v3/users/0793c3f224094d339fe3fa76c4c2275b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:02.810431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0793c3f224094d339fe3fa76c4c2275b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:02.832744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:02.931442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707f5fdda5184f098abb5fd856a21b1c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:02.938324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707f5fdda5184f098abb5fd856a21b1c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.020089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707f5fdda5184f098abb5fd856a21b1c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.042683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0793c3f224094d339fe3fa76c4c2275b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.050835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707f5fdda5184f098abb5fd856a21b1c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.062029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2063b4a4-085e-4595-b8d9-27a240f72968 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707f5fdda5184f098abb5fd856a21b1c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.080454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 868/1713] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:02 2022] DELETE /identity/v3/users/707f5fdda5184f098abb5fd856a21b1c => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:03.081228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.081518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.081797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.085186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0793c3f224094d339fe3fa76c4c2275b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.110451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0793c3f224094d339fe3fa76c4c2275b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.113575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0793c3f224094d339fe3fa76c4c2275b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.154078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-04190a0e-d4cf-464b-8183-cc6c89f3edb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0793c3f224094d339fe3fa76c4c2275b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:03.186465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 846/1714] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:02 2022] DELETE /identity/v3/users/0793c3f224094d339fe3fa76c4c2275b => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:03.188910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87c9a-bfa3-47f6-979d-24e64e233c43 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.190067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] MFA Rules not processed for user `c7e73f3bfbcd41b29dc41bbbd218d413`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:03.190335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87c9a-bfa3-47f6-979d-24e64e233c43 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.190618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb87c9a-bfa3-47f6-979d-24e64e233c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.192779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:03.255254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-4bb87c9a-bfa3-47f6-979d-24e64e233c43 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:03.257048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4bb87c9a-bfa3-47f6-979d-24e64e233c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:03.360794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 869/1715] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:03.383375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 847/1716] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:03.507533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:03.510685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:03.567341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3a70-4840-4a52-903a-5e141580985b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.567821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3a70-4840-4a52-903a-5e141580985b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.568511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629a3a70-4840-4a52-903a-5e141580985b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.628314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-629a3a70-4840-4a52-903a-5e141580985b None None] MFA Rules not processed for user `31b0201bf57647b1b71e0a7bc592bf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:03.629557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-629a3a70-4840-4a52-903a-5e141580985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:03.655868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca4109-5914-452e-9711-3068d7f5554c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:03.676167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870a15dc-d267-43db-97e2-b13424881e92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:03.677054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a15dc-d267-43db-97e2-b13424881e92 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.680953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a15dc-d267-43db-97e2-b13424881e92 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.681294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870a15dc-d267-43db-97e2-b13424881e92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.694463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a15dc-d267-43db-97e2-b13424881e92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:03.697009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870a15dc-d267-43db-97e2-b13424881e92 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:03.741142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:03.753829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 870/1717] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:03.756338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01ffba-9e6b-43b7-896c-c8573ec9a1fc None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.757518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01ffba-9e6b-43b7-896c-c8573ec9a1fc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.757807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01ffba-9e6b-43b7-896c-c8573ec9a1fc None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.761385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 871/1718] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 17 23:27:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:27:03.766809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.767101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.767382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.803051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 848/1719] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:03.822262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:03.849386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:03.850653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:03.877482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 872/1720] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:27:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:03.885607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3a70-4840-4a52-903a-5e141580985b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:03.887756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-629a3a70-4840-4a52-903a-5e141580985b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:03.918446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629a3a70-4840-4a52-903a-5e141580985b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:03.930879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cce6fc-7843-4ddb-b550-6238e54524cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:03.932432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce6fc-7843-4ddb-b550-6238e54524cf service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:03.932888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce6fc-7843-4ddb-b550-6238e54524cf service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:03.933308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cce6fc-7843-4ddb-b550-6238e54524cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:03.951751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce6fc-7843-4ddb-b550-6238e54524cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:03.953361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cce6fc-7843-4ddb-b550-6238e54524cf service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:04.004990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 849/1721] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:04.048802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:04.050859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:04.084359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8cb7ff-db63-45e2-9cab-857b6a5c2f9a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:04.094576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:04.095514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:04.095992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:04.096723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] PATH_INFO: `/v3/projects/de2022d0d0814cd1814239c25ff058e3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:04.098208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2022d0d0814cd1814239c25ff058e3)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:04.100593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:04.183780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2022d0d0814cd1814239c25ff058e3', 'request_id': 'req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:04.194099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2022d0d0814cd1814239c25ff058e3', 'request_id': 'req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:04.211537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2022d0d0814cd1814239c25ff058e3', 'request_id': 'req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:04.226687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] The token cache is being invalidate because project de2022d0d0814cd1814239c25ff058e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:04.227041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:04.230301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2bbabf9b-2d56-4d1e-8db0-cb4b8a9fa562 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:04.232810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 873/1722] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:04 2022] DELETE /identity/v3/projects/de2022d0d0814cd1814239c25ff058e3 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:04.237925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:04.238672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:04.239093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:04.306087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:04.308406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:04.467366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 850/1723] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:04.476641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:04.476839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:04.477120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:04.535101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:04.536290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:04.566932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 874/1724] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:04.567926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:04.594400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504da76-5766-4f99-bde3-c6bd1f6e03d7 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:04.609311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:04.609952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:04.610237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:04.610510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:04.615490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:04.615694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:04.617347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:04.652859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 851/1725] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:27:04.653300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:04.667714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6670fdc-1db1-4c92-a66c-a44d165d7469 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:04.680706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:04.681402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:04.682266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:04.682554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:04.685180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:04.687457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:04.773262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 875/1726] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:04 2022] POST /identity/v3/projects => generated 369 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:04.778735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:04.796695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97bf73a2-b47d-45ac-8d21-50d9809597d7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:04.858817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:04.861320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:04.980571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b6741-60a4-4b10-bdea-130f380253c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:04.981210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b6741-60a4-4b10-bdea-130f380253c3 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:04.981495 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b6741-60a4-4b10-bdea-130f380253c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:04.986187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b6741-60a4-4b10-bdea-130f380253c3 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:04.988829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b6741-60a4-4b10-bdea-130f380253c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:04.996661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbfcb62-2dd8-4ff9-bf33-0978488a824d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:05.003388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:05.003976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.004213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.004495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.007191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.015728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b6741-60a4-4b10-bdea-130f380253c3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:05.083595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 852/1727] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:04 2022] POST /identity/v3/users => generated 285 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:05.084767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ca97-039a-4505-a311-28b528b63e15 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.085061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ca97-039a-4505-a311-28b528b63e15 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.085336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5ca97-039a-4505-a311-28b528b63e15 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.092016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 853/1728] 10.222.0.39 () {54 vars in 912 bytes} [Wed Aug 17 23:27:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:27:05.093259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfc2b0-c8b3-478c-b667-57e6029d3ee1 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.093500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfc2b0-c8b3-478c-b667-57e6029d3ee1 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.094404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdfc2b0-c8b3-478c-b667-57e6029d3ee1 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.095127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 854/1729] 10.222.0.39 () {54 vars in 961 bytes} [Wed Aug 17 23:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:27:05.097781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfc2b0-c8b3-478c-b667-57e6029d3ee1 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:05.101926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:05.159165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdfc2b0-c8b3-478c-b667-57e6029d3ee1 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:05.183646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:05.185425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0431b9-5259-4f88-8939-4617b7149f7a service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:05.206215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b594fd-efd5-4737-a41e-2a3b207bca45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:05.221977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b594fd-efd5-4737-a41e-2a3b207bca45 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.223637 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b594fd-efd5-4737-a41e-2a3b207bca45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.225120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b594fd-efd5-4737-a41e-2a3b207bca45 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.227420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b594fd-efd5-4737-a41e-2a3b207bca45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:05.236096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 876/1730] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:05.241995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.241995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.241995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.257535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b594fd-efd5-4737-a41e-2a3b207bca45 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:05.311338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:05.312994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.329391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 855/1731] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:05.337824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210cc9-2557-4a00-9578-466d7975ba53 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.338263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210cc9-2557-4a00-9578-466d7975ba53 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.338847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3210cc9-2557-4a00-9578-466d7975ba53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.390150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d3210cc9-2557-4a00-9578-466d7975ba53 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:05.391423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d3210cc9-2557-4a00-9578-466d7975ba53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.465908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 877/1732] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:27:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:05.467015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:05.471640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:05.503539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b192f7-fcb8-431d-b120-50c57d6215a4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:05.521722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:05.522366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.522647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.522945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.523608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:05.527258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:05.528951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 856/1733] 10.222.0.39 () {58 vars in 1058 bytes} [Wed Aug 17 23:27:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:05.530576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.531430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.532122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.567210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 878/1734] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:05.568948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:05.573365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] MFA Rules not processed for user `c7ce99c5bac948a7bccd3fdf5cb2e462`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:05.576502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.577510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.605305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e49cc1-01de-4bc4-880e-f2e505f10aba admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:05.616506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:05.617172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.617455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.617731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] PATH_INFO: `/v3/projects/173592a1b0a74ae6a248f31af62e5a6b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.627635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=173592a1b0a74ae6a248f31af62e5a6b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:05.629993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:05.726827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 857/1735] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:05.727904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:05.733680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.746910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '173592a1b0a74ae6a248f31af62e5a6b', 'request_id': 'req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:05.764665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '173592a1b0a74ae6a248f31af62e5a6b', 'request_id': 'req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:05.768243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66de1ccb-721d-4906-948b-f6f1098ee175 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:05.804858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '173592a1b0a74ae6a248f31af62e5a6b', 'request_id': 'req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:05.845261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] The token cache is being invalidate because project 173592a1b0a74ae6a248f31af62e5a6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:05.845718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:05.846477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:05.854511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 879/1736] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:05 2022] DELETE /identity/v3/projects/173592a1b0a74ae6a248f31af62e5a6b => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:05.854511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:05.867694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.909921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:05.927651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.928017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.928650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.932742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.946420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:05.948644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:05.963680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 858/1737] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:05.964619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:05.966627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:05.980558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bc45c-ad70-4dd5-9436-7c0d428f6fd4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:05.989959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:05.991508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:05.991954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:05.993207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:05.997908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:06.016107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:06.018802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d82f73-3189-4e13-8486-195b6385b773 service placement] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:06.033687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:06.042065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 880/1738] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:06.044063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:06.045281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:06.045748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:06.082515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] MFA Rules not processed for user `8c10c73d9ffa4f849c45e77926c0b0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:06.085776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:06.100924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae4e51-fb3a-4807-9f3b-6a9d95d5ffb5 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:06.118187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba3257-e51f-4b04-af93-e38c59017345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:06.118907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba3257-e51f-4b04-af93-e38c59017345 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:06.119733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba3257-e51f-4b04-af93-e38c59017345 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:06.120085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba3257-e51f-4b04-af93-e38c59017345 admin admin] PATH_INFO: `/v3/projects/c435706f81044eb7b0d1ca69612901f6/users/e65ba31ec79940eca654393d89d78ef2/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:06.153507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:06.159546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba3257-e51f-4b04-af93-e38c59017345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c435706f81044eb7b0d1ca69612901f6, user_id=e65ba31ec79940eca654393d89d78ef2, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:06.170303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ba3257-e51f-4b04-af93-e38c59017345 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:06.200096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 859/1739] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:05 2022] PUT /identity/v3/projects/c435706f81044eb7b0d1ca69612901f6/users/e65ba31ec79940eca654393d89d78ef2/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:06.203962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3732a0d-154f-42d2-825b-8c80d80c788c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:06.205254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3732a0d-154f-42d2-825b-8c80d80c788c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:06.206084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3732a0d-154f-42d2-825b-8c80d80c788c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:06.244749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 881/1740] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:06.249006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:06.250369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:06.252007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a3732a0d-154f-42d2-825b-8c80d80c788c None None] MFA Rules not processed for user `c7ce99c5bac948a7bccd3fdf5cb2e462`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:06.254478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a3732a0d-154f-42d2-825b-8c80d80c788c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:06.282624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29882d65-769d-42ae-b955-f26c60c9ad18 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:06.412936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 860/1741] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:06.415435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:06.416311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:06.417042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:06.436264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:06.436925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:06.437266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:06.437656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] PATH_INFO: `/v3/users/f0689ddef8fa45d79720a7ab86e22172` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:06.438930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0689ddef8fa45d79720a7ab86e22172)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:06.440843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:06.531831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] MFA Rules not processed for user `e65ba31ec79940eca654393d89d78ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:06.533385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:06.545062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0689ddef8fa45d79720a7ab86e22172'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:06.548721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0689ddef8fa45d79720a7ab86e22172'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:06.583829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0689ddef8fa45d79720a7ab86e22172'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:06.600684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0689ddef8fa45d79720a7ab86e22172'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:06.622500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0689ddef8fa45d79720a7ab86e22172'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:06.646554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 882/1742] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:06 2022] DELETE /identity/v3/users/f0689ddef8fa45d79720a7ab86e22172 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:06.904430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:06.904800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 861/1743] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:06.906294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:07.025176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:07.195090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900b8d-9ea1-418c-8cc5-0d98e178e67b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:07.234416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:07.235098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:07.235389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:07.235675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:07.236341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:07.249505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:07.306191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:07.308178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:07.363689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 883/1744] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:06 2022] POST /identity/v3/projects => generated 367 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:07.367071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:07.564387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c7ef04-d622-4870-b5b7-e9ecd5fbe8a5 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:07.568111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988cff08-517c-46b3-afc1-1ec41be6ebe4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:07.592089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:07.593194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:07.593982 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:07.594498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:07.598347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:07.601429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:07.609001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:07.663577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 884/1745] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:07 2022] POST /identity/v3/users => generated 290 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:07.668449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:07.696225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fbf020-af02-4cbf-ac81-e106dc35032f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:07.709045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:07.712414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:07.712414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:07.713904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:07.715358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:07.724683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:07.795665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 885/1746] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:07 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:07.795665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:07.798051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:07.821217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:07.821862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:07.822149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:07.822488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:07.828233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:07.836436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5211db9b-14e8-4d6e-a325-d71513d436c4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:07.861138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:07.866262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:07.866873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:07.867342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] PATH_INFO: `/v3/projects/1633684c6344412299219059d105dca5` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:07.871382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1633684c6344412299219059d105dca5)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:07.876665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:08.056038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:08.057992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:08.076458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1633684c6344412299219059d105dca5', 'request_id': 'req-d1216a84-0f3e-4178-a96e-c850be58cb97'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:08.087124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 862/1747] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 781 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:08.088585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:08.114606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1633684c6344412299219059d105dca5', 'request_id': 'req-d1216a84-0f3e-4178-a96e-c850be58cb97'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:08.126214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717d623a-48eb-4faf-b5d8-a868bc4507b5 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:08.152815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1633684c6344412299219059d105dca5', 'request_id': 'req-d1216a84-0f3e-4178-a96e-c850be58cb97'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:08.169683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] The token cache is being invalidate because project 1633684c6344412299219059d105dca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:08.169975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:08.177648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d1216a84-0f3e-4178-a96e-c850be58cb97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:08.188686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 886/1748] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:07 2022] DELETE /identity/v3/projects/1633684c6344412299219059d105dca5 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:08.190376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f176938-a8a4-445f-806b-ea11c5a0cc66 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:08.190674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f176938-a8a4-445f-806b-ea11c5a0cc66 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:08.190986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f176938-a8a4-445f-806b-ea11c5a0cc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:08.251316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2f176938-a8a4-445f-806b-ea11c5a0cc66 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:08.256408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2f176938-a8a4-445f-806b-ea11c5a0cc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:08.268502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:08.474433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 887/1749] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:08.482984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:08.486692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:08.488454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:08.489594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] PATH_INFO: `/v3/projects/dae1f5743a634c218b12fc9ad0f60722/users/680cd5ac48134f0a8863ec4afd8ce14b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:08.492259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:08.492756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:08.493193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:08.549826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:08.552759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:08.577752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 888/1750] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:08.580882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:08.606040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdeb88b-6bbc-4d97-9f74-dfa03aaed5d8 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:08.607744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae1f5743a634c218b12fc9ad0f60722, user_id=680cd5ac48134f0a8863ec4afd8ce14b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:08.620332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:08.621144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:08.621427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:08.621697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:08.622364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:08.622666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:08.632704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:08.640538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:08.678845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 863/1751] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:08 2022] PUT /identity/v3/projects/dae1f5743a634c218b12fc9ad0f60722/users/680cd5ac48134f0a8863ec4afd8ce14b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:08.680679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:08.683291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:08.698217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 889/1752] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:08.699451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:08.761530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66502cb7-d697-4dd2-a6f2-29e8f02bdfc1 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:08.927876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:08.944525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:08.945165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:08.945451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:08.948150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:08.949159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:08.953090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:09.029022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 890/1753] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:08 2022] POST /identity/v3/projects => generated 373 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:09.034471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf4f3fd-6d20-4652-ad60-711a253256b6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:09.040051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:09.262000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:09.266100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.268921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.271413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:09.272312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:09.283861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:09.319108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06be1d6e-2d36-4cce-8e56-d0f36a88e42c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:09.327943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:09.328903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.329129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.329601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:09.330266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:09.337421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:09.351132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 864/1754] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:08 2022] GET /identity/v3/roles => generated 1420 bytes in 671 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:09.352119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:09.388920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d06bf-7a1d-46d6-93a2-3ff2d0deb982 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:09.404293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 891/1755] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:09 2022] POST /identity/v3/users => generated 287 bytes in 364 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:09.406377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:09.408824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0346a2d8-1f77-473d-9043-17278ca4ddd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:09.409520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346a2d8-1f77-473d-9043-17278ca4ddd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.409808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346a2d8-1f77-473d-9043-17278ca4ddd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.410193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0346a2d8-1f77-473d-9043-17278ca4ddd4 admin admin] PATH_INFO: `/v3/projects/dae1f5743a634c218b12fc9ad0f60722/users/680cd5ac48134f0a8863ec4afd8ce14b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:09.423228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:09.427494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346a2d8-1f77-473d-9043-17278ca4ddd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae1f5743a634c218b12fc9ad0f60722, user_id=680cd5ac48134f0a8863ec4afd8ce14b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:09.430581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0346a2d8-1f77-473d-9043-17278ca4ddd4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:09.442505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966512d8-c297-4962-a527-f92a69c3d06f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:09.456016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:09.457854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.458153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.459690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:09.460848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:09.466501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:09.468365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 865/1756] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:09 2022] PUT /identity/v3/projects/dae1f5743a634c218b12fc9ad0f60722/users/680cd5ac48134f0a8863ec4afd8ce14b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:09.478938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.480209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.480653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:09.504871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 892/1757] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:09.506344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:09.558554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f877434-6d36-4f97-a426-c95773a9ea29 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:09.593992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] MFA Rules not processed for user `680cd5ac48134f0a8863ec4afd8ce14b`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:09.599242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:09.892188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:09.892836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.893120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.893976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:09.894265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:09.897306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:09.919906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 893/1758] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:09 2022] GET /identity/v3/roles => generated 1420 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:09.921275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 866/1759] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:09.924986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:09.935743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:09.937316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:09.957245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d79e6c-7fdd-4ab2-94cc-eb4a80a83774 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:09.964839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02522e6-9bd4-452c-89d0-d3fb1c91796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:09.965747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02522e6-9bd4-452c-89d0-d3fb1c91796c admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:09.966334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02522e6-9bd4-452c-89d0-d3fb1c91796c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:09.966812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02522e6-9bd4-452c-89d0-d3fb1c91796c admin admin] PATH_INFO: `/v3/projects/1332a20158934e21bb3dd07a3a21c46e/users/89f73cc56d9d48d39847f64f32161e66/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:10.040475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02522e6-9bd4-452c-89d0-d3fb1c91796c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1332a20158934e21bb3dd07a3a21c46e, user_id=89f73cc56d9d48d39847f64f32161e66, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:10.047184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02522e6-9bd4-452c-89d0-d3fb1c91796c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:10.099019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 894/1760] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:09 2022] PUT /identity/v3/projects/1332a20158934e21bb3dd07a3a21c46e/users/89f73cc56d9d48d39847f64f32161e66/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:10.104400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:10.106253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:10.108661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:10.169155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1dcaa-1153-4ef8-93b9-a75bbeb4f882 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:10.186028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:10.190899 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:10.197981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:10.348557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a47e845-c8bf-4b79-b8b3-138fe22226bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:10.351486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47e845-c8bf-4b79-b8b3-138fe22226bd service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:10.351780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47e845-c8bf-4b79-b8b3-138fe22226bd service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:10.355210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a47e845-c8bf-4b79-b8b3-138fe22226bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:10.492382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 895/1761] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:10.594109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:10.595878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:10.601663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47e845-c8bf-4b79-b8b3-138fe22226bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:10.607875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a47e845-c8bf-4b79-b8b3-138fe22226bd service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:10.648774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 867/1762] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:09 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:10.718921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:10.718921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:10.718921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:10.854549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cb8c3d-72e6-4d6b-a4c7-927e6007611a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:10.877280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f70f9f-64e7-4890-a6f8-7c7c3295c831 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:10.897995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70f9f-64e7-4890-a6f8-7c7c3295c831 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:10.903943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70f9f-64e7-4890-a6f8-7c7c3295c831 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:10.905262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f70f9f-64e7-4890-a6f8-7c7c3295c831 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:10.923062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:10.924812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:11.030800 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70f9f-64e7-4890-a6f8-7c7c3295c831 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:11.050225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f70f9f-64e7-4890-a6f8-7c7c3295c831 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:11.131229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 868/1763] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:27:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:11.145554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 896/1764] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:11.512437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:11.515364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:11.701311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:11.944807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c96323-00e1-4613-86a8-945e75ccb330 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:11.976851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:11.981284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:11.985121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:11.985426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:12.027730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:12.034655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:12.078367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 869/1765] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:27:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:27:15.032374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180ebf-caa7-46f1-acc3-83cde4fdeb04 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:15.034970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180ebf-caa7-46f1-acc3-83cde4fdeb04 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:15.039281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d180ebf-caa7-46f1-acc3-83cde4fdeb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:15.091822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9d180ebf-caa7-46f1-acc3-83cde4fdeb04 None None] MFA Rules not processed for user `31b0201bf57647b1b71e0a7bc592bf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:15.097385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9d180ebf-caa7-46f1-acc3-83cde4fdeb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:15.134035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:15.293325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 897/1766] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:15.789463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:15.820581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17186673-e1d5-4d34-aacb-bf915408f3bf service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:15.846821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:15.847778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:15.850032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:15.851124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] PATH_INFO: `/v3/users/e65ba31ec79940eca654393d89d78ef2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:15.852685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e65ba31ec79940eca654393d89d78ef2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:15.855630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:16.019926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e65ba31ec79940eca654393d89d78ef2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:16.066262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e65ba31ec79940eca654393d89d78ef2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:16.079860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e65ba31ec79940eca654393d89d78ef2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:16.080631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e65ba31ec79940eca654393d89d78ef2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:16.093882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e65ba31ec79940eca654393d89d78ef2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:16.118877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 870/1767] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:15 2022] DELETE /identity/v3/users/e65ba31ec79940eca654393d89d78ef2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:16.121223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e2cd-75f7-42f5-9685-8af8673118b0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:16.121223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e2cd-75f7-42f5-9685-8af8673118b0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:16.121859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027e2cd-75f7-42f5-9685-8af8673118b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:16.214478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a027e2cd-75f7-42f5-9685-8af8673118b0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:16.221234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a027e2cd-75f7-42f5-9685-8af8673118b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:16.394650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 898/1768] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:16.407940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:16.409616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:16.568734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd08faf-80e9-4d9d-894f-b0d46834851d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:16.578385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:16.579115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:16.579374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:16.579680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:16.600735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:16.603587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:16.627246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 871/1769] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:17.944507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:17.945029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:17.945375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:18.045583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:18.064729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:18.097521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 899/1770] 10.222.0.52 () {58 vars in 1015 bytes} [Wed Aug 17 23:27:17 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:18.355748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:18.357694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:18.366676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:18.377232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97046769-bbde-461e-b26b-f18991dd49cc None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:18.391569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:18.393553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:18.395040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:18.396798 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:18.406501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b856bd2-970f-4303-bd6f-811f43d33059 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:18.422122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:18.423657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:18.424401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:18.425062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:18.434504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:18.436027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:18.439013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:18.442035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:18.456127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 872/1771] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:18.475340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 900/1772] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:19.027023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:19.028941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:19.066444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e34edda-1003-45bd-9676-11f11af83fdf service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:19.083446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:19.087261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:19.092618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:19.093253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] PATH_INFO: `/v3/projects/c435706f81044eb7b0d1ca69612901f6` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:19.096914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c435706f81044eb7b0d1ca69612901f6)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:19.107017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:19.114094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:19.251440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c435706f81044eb7b0d1ca69612901f6', 'request_id': 'req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.265174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c435706f81044eb7b0d1ca69612901f6', 'request_id': 'req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.283924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c435706f81044eb7b0d1ca69612901f6', 'request_id': 'req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.303660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] The token cache is being invalidate because project c435706f81044eb7b0d1ca69612901f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:19.303968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.304780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-473bf9b1-8d6a-4056-b7bd-7a8fa33e9a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.309929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 873/1773] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:19 2022] DELETE /identity/v3/projects/c435706f81044eb7b0d1ca69612901f6 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:19.311176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:19.328058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7176fc-1445-4bb0-b6d5-4aba8de60ee9 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:19.443501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:19.444785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:19.447754 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:19.448626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] PATH_INFO: `/v3/users/680cd5ac48134f0a8863ec4afd8ce14b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:19.453821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] RBAC: Authorizing `identity:delete_user(user_id=680cd5ac48134f0a8863ec4afd8ce14b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:19.458526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:19.662273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:19.721096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '680cd5ac48134f0a8863ec4afd8ce14b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.726187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '680cd5ac48134f0a8863ec4afd8ce14b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.838529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '680cd5ac48134f0a8863ec4afd8ce14b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.887269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '680cd5ac48134f0a8863ec4afd8ce14b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.916422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '680cd5ac48134f0a8863ec4afd8ce14b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:19.958936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 901/1774] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:19 2022] DELETE /identity/v3/users/680cd5ac48134f0a8863ec4afd8ce14b => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:20.691267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:20.691770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:20.692505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:20.729359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:20.731333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:20.803001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] MFA Rules not processed for user `89f73cc56d9d48d39847f64f32161e66`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:20.804976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:21.033180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad87475c-c4e2-4433-858e-487683f0e74f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:21.043572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:21.045192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.045630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.046093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] PATH_INFO: `/v3/users/40a8dc2209c3411c9334547e0e0e7cc7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.048076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] RBAC: Authorizing `identity:delete_user(user_id=40a8dc2209c3411c9334547e0e0e7cc7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:21.052033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:21.057943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 874/1775] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:21.063803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:21.069072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:21.173690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa805c-442b-49d4-bec3-7f5f8c007fb7 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:21.184640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:21.185292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.187320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.188764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.189792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:21.196289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:21.241216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40a8dc2209c3411c9334547e0e0e7cc7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:21.242297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40a8dc2209c3411c9334547e0e0e7cc7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:21.272931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40a8dc2209c3411c9334547e0e0e7cc7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:21.299949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 875/1776] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:21 2022] POST /identity/v3/projects => generated 371 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:21.304983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:21.309283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40a8dc2209c3411c9334547e0e0e7cc7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:21.325200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c8e0ea1f-6638-4527-a528-f0469e87610d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40a8dc2209c3411c9334547e0e0e7cc7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:21.339282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 902/1777] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:20 2022] DELETE /identity/v3/users/40a8dc2209c3411c9334547e0e0e7cc7 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:21.343517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.343802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.344002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.390594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:21.391902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:21.464458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:21.475786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:21.482143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db89de94-f1d7-4f64-ad90-da38e67f9932 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:21.586956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 903/1778] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:21.680210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:21.680934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.681897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.682224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.684257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:21.691781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:21.736624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:21.738117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:21.740502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 876/1779] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:21 2022] POST /identity/v3/users => generated 292 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:21.745253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:21.752466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:21.797453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44e3c61-99d9-4aea-a62d-e54ae6ef9f32 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:21.827640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:21.828997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.829652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.830826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.832291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:21.835799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:21.863644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 877/1780] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:21.867814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:21.889491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1de20-51a8-4231-b977-561df8e39530 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:21.898287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34160b71-dd05-4d80-8b8f-f2b7be72777d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:21.899908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34160b71-dd05-4d80-8b8f-f2b7be72777d admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.907404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34160b71-dd05-4d80-8b8f-f2b7be72777d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.907956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34160b71-dd05-4d80-8b8f-f2b7be72777d admin admin] PATH_INFO: `/v3/projects/94f84d30a54e4775aaa301a676900207/users/93481c532d314d2a9c792bb77cebc8b9/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.921346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f67b47-f7e2-4912-a92f-7a814136ad02 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:21.934105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34160b71-dd05-4d80-8b8f-f2b7be72777d admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f84d30a54e4775aaa301a676900207, user_id=93481c532d314d2a9c792bb77cebc8b9, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:21.934511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:21.935341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.935779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.936206 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:21.937053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34160b71-dd05-4d80-8b8f-f2b7be72777d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:21.965909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:21.973295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:21.991742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 878/1781] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:21 2022] PUT /identity/v3/projects/94f84d30a54e4775aaa301a676900207/users/93481c532d314d2a9c792bb77cebc8b9/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:21.995942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bd16-b379-4d50-86d7-72ddacc041da None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:21.996504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bd16-b379-4d50-86d7-72ddacc041da None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:21.996937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb1bd16-b379-4d50-86d7-72ddacc041da None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:22.001670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 879/1782] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:27:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:27:22.003179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1bd16-b379-4d50-86d7-72ddacc041da None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:22.013129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 904/1783] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:22.099593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb1bd16-b379-4d50-86d7-72ddacc041da None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:22.106906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23ac12-ed1c-42cd-aa48-81ececc8743d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:22.108145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ac12-ed1c-42cd-aa48-81ececc8743d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:22.108592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ac12-ed1c-42cd-aa48-81ececc8743d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:22.109025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23ac12-ed1c-42cd-aa48-81ececc8743d admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:22.109853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23ac12-ed1c-42cd-aa48-81ececc8743d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:22.111696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23ac12-ed1c-42cd-aa48-81ececc8743d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:22.126982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 880/1784] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:22 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:22.131984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:22.148180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5586974-ba15-4e2c-a11a-4c3364d94b6f service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:22.157732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:22.158726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:22.159395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:22.159837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] PATH_INFO: `/v3/projects/94f84d30a54e4775aaa301a676900207/users/93481c532d314d2a9c792bb77cebc8b9/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:22.162313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94f84d30a54e4775aaa301a676900207, user_id=93481c532d314d2a9c792bb77cebc8b9, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:22.166635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:22.190210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 905/1785] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:22 2022] PUT /identity/v3/projects/94f84d30a54e4775aaa301a676900207/users/93481c532d314d2a9c792bb77cebc8b9/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:22.259909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:22.260948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:22.263128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:22.328190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:22.329428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:22.485720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:22.557555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 881/1786] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:27:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:22.697852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:22.700486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:22.896765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3588f92-35a0-4cde-9a4d-4fa3b5de0984 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:22.912990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:22.913663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:22.914484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:22.914484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] PATH_INFO: `/v3/projects/dae1f5743a634c218b12fc9ad0f60722` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:22.926153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae1f5743a634c218b12fc9ad0f60722)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:22.937276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:23.059331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:23.061457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:23.109439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81152477-ad48-4fb2-91c2-217dc7dafd94 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:23.111271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae1f5743a634c218b12fc9ad0f60722', 'request_id': 'req-1f1952a7-2ce7-49a2-86da-aa6804e917df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:23.127869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae1f5743a634c218b12fc9ad0f60722', 'request_id': 'req-1f1952a7-2ce7-49a2-86da-aa6804e917df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:23.146382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae1f5743a634c218b12fc9ad0f60722', 'request_id': 'req-1f1952a7-2ce7-49a2-86da-aa6804e917df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:23.147864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:23.180158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] The token cache is being invalidate because project dae1f5743a634c218b12fc9ad0f60722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:23.180684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:23.182253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1f1952a7-2ce7-49a2-86da-aa6804e917df admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:23.185694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 906/1787] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:22 2022] DELETE /identity/v3/projects/dae1f5743a634c218b12fc9ad0f60722 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:23.191057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.191387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.192526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.238511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:23.240100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:23.285065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:23.285779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.286000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.286357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.288842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:23.304783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:23.316708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b4ddb9-f171-4149-99ec-d32cca3d075c service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:23.388700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 882/1788] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:23.425447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 907/1789] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:23.427481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.429036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.429475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.470261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:23.471796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:23.484960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 883/1790] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:23.486188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:23.498188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c6b56-629a-4384-a865-d6309b9797b5 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:23.505549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:23.506865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.507388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.507953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.508981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:23.509541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:23.511233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:23.548697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 908/1791] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:23.552353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:23.571656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c30651-b43b-4759-acdf-7f468892196c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:23.586602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:23.589958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.591177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.591603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.593189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:23.607559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:23.663272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 884/1792] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:23 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:23.664425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:23.684738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dab8733-d7f5-41ae-8a2b-942729e91056 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:23.829884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:23.832564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.834344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.835195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.836582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:23.840307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:23.889048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 909/1793] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:23 2022] POST /identity/v3/users => generated 291 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:23.892273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:23.921562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b755f1-fb6c-4deb-8fad-7186be8b7929 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:23.933982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:23.938983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:23.939911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:23.940922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:23.942515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:23.946165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:23.971496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 885/1794] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:23.971615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:23.984842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-face4dd6-9faf-4f7f-b18b-b524e7692f55 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:24.003155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a7c7a2-6ee0-433f-b6bf-f013f5d3bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:24.003825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7c7a2-6ee0-433f-b6bf-f013f5d3bdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.004165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7c7a2-6ee0-433f-b6bf-f013f5d3bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.004364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a7c7a2-6ee0-433f-b6bf-f013f5d3bdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.005089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7c7a2-6ee0-433f-b6bf-f013f5d3bdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:24.006658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a7c7a2-6ee0-433f-b6bf-f013f5d3bdc7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:24.038454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 910/1795] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:23 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:24.039857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:24.056766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39884e4-3a9c-4944-b58b-2e5db413305f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:24.079145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:24.085733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.087203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.087592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] PATH_INFO: `/v3/projects/b558c3982c664735a9b69c4203ec779d/users/4d3b61e1b66b4feb91b14bc4c2be9027/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.135650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b558c3982c664735a9b69c4203ec779d, user_id=4d3b61e1b66b4feb91b14bc4c2be9027, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:24.139750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:24.175136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 886/1796] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:24 2022] PUT /identity/v3/projects/b558c3982c664735a9b69c4203ec779d/users/4d3b61e1b66b4feb91b14bc4c2be9027/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:24.186308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.186605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.186915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.293679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] MFA Rules not processed for user `4d3b61e1b66b4feb91b14bc4c2be9027`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:24.303562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:24.400711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:24.466233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 911/1797] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:24 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:24.469522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:24.594512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8446ced6-e97c-4fb0-b44f-7d0f574e77a4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:24.601922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:24.602563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.602892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.603921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.605906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:24.609383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:24.631575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:24.655111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 887/1798] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:24 2022] POST /identity/v3/projects => generated 381 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:24.658295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:24.678558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6394ed4-a79e-4f16-acf9-6d01541d941a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:24.751264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21d1aee-98fa-4fcf-8f59-9bc46dc3c80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:24.751627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1aee-98fa-4fcf-8f59-9bc46dc3c80b admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.752063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1aee-98fa-4fcf-8f59-9bc46dc3c80b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.752719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21d1aee-98fa-4fcf-8f59-9bc46dc3c80b admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.753514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1aee-98fa-4fcf-8f59-9bc46dc3c80b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:24.755271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21d1aee-98fa-4fcf-8f59-9bc46dc3c80b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:24.783406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 912/1799] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:24 2022] POST /identity/v3/users => generated 297 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:24.785494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:24.796841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7e464-20c9-4ce5-92a6-ea25c0467acf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:24.802160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e90b-ef46-4a3e-a0df-ed71c39c16fa None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.802813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e90b-ef46-4a3e-a0df-ed71c39c16fa None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.803282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9430e90b-ef46-4a3e-a0df-ed71c39c16fa None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.803583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172172c6-584b-4051-bfb4-468ed5343767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:24.804856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172172c6-584b-4051-bfb4-468ed5343767 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.804978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172172c6-584b-4051-bfb4-468ed5343767 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.806065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172172c6-584b-4051-bfb4-468ed5343767 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.807544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172172c6-584b-4051-bfb4-468ed5343767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:24.810438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172172c6-584b-4051-bfb4-468ed5343767 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:24.812628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 913/1800] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:27:24 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:27:24.826754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 888/1801] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:24.829825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e90b-ef46-4a3e-a0df-ed71c39c16fa None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:24.836859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.837101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.838157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.867826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9430e90b-ef46-4a3e-a0df-ed71c39c16fa None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:24.905801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:24.906573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:24.907314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:24.907599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:24.907878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] PATH_INFO: `/v3/projects/772cc6c440814d62a80d5bdc1a7fbd2d/users/a074cab7761743f5abc0626037abf5a3/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:24.909569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:24.948723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] RBAC: Authorizing `identity:create_grant(project_id=772cc6c440814d62a80d5bdc1a7fbd2d, user_id=a074cab7761743f5abc0626037abf5a3, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:24.951475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:24.970738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 914/1802] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:24 2022] PUT /identity/v3/projects/772cc6c440814d62a80d5bdc1a7fbd2d/users/a074cab7761743f5abc0626037abf5a3/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:24.974841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:25.053123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 889/1803] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:27:24 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:25.064591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944b54f8-0b4b-4bf0-ade6-986440a3388d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:25.070046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b538f3b-c1c8-44bc-93fc-5b644caeee29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:25.071076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538f3b-c1c8-44bc-93fc-5b644caeee29 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.071792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538f3b-c1c8-44bc-93fc-5b644caeee29 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.072008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b538f3b-c1c8-44bc-93fc-5b644caeee29 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.072929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538f3b-c1c8-44bc-93fc-5b644caeee29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:25.074678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b538f3b-c1c8-44bc-93fc-5b644caeee29 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:25.086483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 915/1804] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:24 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:25.092450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:25.115702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d6c707-cfe3-43eb-b195-4e647ed334e8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:25.121298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:25.122383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.122917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.123368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] PATH_INFO: `/v3/projects/772cc6c440814d62a80d5bdc1a7fbd2d/users/a074cab7761743f5abc0626037abf5a3/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.125562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=772cc6c440814d62a80d5bdc1a7fbd2d, user_id=a074cab7761743f5abc0626037abf5a3, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:25.128353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:25.141271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 890/1805] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:25 2022] PUT /identity/v3/projects/772cc6c440814d62a80d5bdc1a7fbd2d/users/a074cab7761743f5abc0626037abf5a3/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:25.152840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.153138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.153441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.185761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] MFA Rules not processed for user `a074cab7761743f5abc0626037abf5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:25.187033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:25.191708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:25.194087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:25.254022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:25.311698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 916/1806] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:25.324351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:25.326734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:25.333855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f8e1e1-fd5d-455a-a2a9-84243be2c621 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:25.343890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:25.344549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.345266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.345378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.359173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:25.361560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:25.379083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 891/1807] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:25.421431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c64ecd7-d0a2-4179-824b-fb435cfe180b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:25.425677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7607cfff-7bcb-4ab8-94ca-4a2f715d3120 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:25.426423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607cfff-7bcb-4ab8-94ca-4a2f715d3120 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.427170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607cfff-7bcb-4ab8-94ca-4a2f715d3120 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.427300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7607cfff-7bcb-4ab8-94ca-4a2f715d3120 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.438915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607cfff-7bcb-4ab8-94ca-4a2f715d3120 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:25.440867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7607cfff-7bcb-4ab8-94ca-4a2f715d3120 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:25.453903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 917/1808] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:25.633845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:25.636789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:25.781441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0172-f801-4588-b22e-1ba0aebec66d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.782243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0172-f801-4588-b22e-1ba0aebec66d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.782742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f0172-f801-4588-b22e-1ba0aebec66d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.813328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:25.826655 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-212f0172-f801-4588-b22e-1ba0aebec66d None None] MFA Rules not processed for user `93481c532d314d2a9c792bb77cebc8b9`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:25.840418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-212f0172-f801-4588-b22e-1ba0aebec66d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:25.874413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d0d8c-3fe5-4231-a5f9-a72b0d2050b1 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:25.899553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:25.903571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:25.904060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:25.904697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] PATH_INFO: `/v3/projects/74b1b368b5034d0a83cb6495f65466d5` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:25.909897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=74b1b368b5034d0a83cb6495f65466d5)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:25.916304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:25.995060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 918/1809] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:25 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:26.005292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:26.005741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:26.006193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:26.032670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] MFA Rules not processed for user `89f73cc56d9d48d39847f64f32161e66`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:26.034363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.046413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74b1b368b5034d0a83cb6495f65466d5', 'request_id': 'req-1c83740d-bec1-45b4-8103-cd7af256ea1b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.061867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74b1b368b5034d0a83cb6495f65466d5', 'request_id': 'req-1c83740d-bec1-45b4-8103-cd7af256ea1b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.080630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74b1b368b5034d0a83cb6495f65466d5', 'request_id': 'req-1c83740d-bec1-45b4-8103-cd7af256ea1b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.112345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] The token cache is being invalidate because project 74b1b368b5034d0a83cb6495f65466d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:26.116944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.119468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.125965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 892/1810] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:25 2022] DELETE /identity/v3/projects/74b1b368b5034d0a83cb6495f65466d5 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:26.126915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:26.131409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.184371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 919/1811] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:26.248154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:26.249816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.262421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:26.270972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c83740d-bec1-45b4-8103-cd7af256ea1b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:26.282444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:26.288330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:26.289020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:26.289319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] PATH_INFO: `/v3/users/a57b26307b704fbf8643af72da3bebe9` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:26.291485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57b26307b704fbf8643af72da3bebe9)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:26.294053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:26.402627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caffa080-1ddf-426f-936d-22709abfaa81 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:26.411613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:26.412249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:26.412576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:26.412859 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:26.415538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.415894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57b26307b704fbf8643af72da3bebe9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.438009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:26.440949 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:26.450816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57b26307b704fbf8643af72da3bebe9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.460196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 920/1812] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:26.461435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:26.464823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.470017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57b26307b704fbf8643af72da3bebe9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.470993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57b26307b704fbf8643af72da3bebe9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.482799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:26.486273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8e10ade-0674-49ee-92f3-aecb1b4d324a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57b26307b704fbf8643af72da3bebe9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.498088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9517e-8f5f-47b2-a576-cf8952889473 service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:26.505177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 893/1813] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:26 2022] DELETE /identity/v3/users/a57b26307b704fbf8643af72da3bebe9 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:26.507552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:26.508336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:26.508720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:26.509095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] PATH_INFO: `/v3/users/4d3b61e1b66b4feb91b14bc4c2be9027` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:26.510936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d3b61e1b66b4feb91b14bc4c2be9027)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:26.513194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:26.629134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d3b61e1b66b4feb91b14bc4c2be9027'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.631283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d3b61e1b66b4feb91b14bc4c2be9027'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.663002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d3b61e1b66b4feb91b14bc4c2be9027'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.678139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d3b61e1b66b4feb91b14bc4c2be9027'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.686789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d3b61e1b66b4feb91b14bc4c2be9027'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:26.693892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 921/1814] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:26 2022] DELETE /identity/v3/users/4d3b61e1b66b4feb91b14bc4c2be9027 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:26.698763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:26.699062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:26.699351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:26.720415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:26.721757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.820362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 894/1815] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:26.845376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:26.846916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:26.964978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb3f0b5-c4af-404d-b157-59a870a7e7a8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:26.971445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:26.972007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:26.972298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:26.972566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:26.986099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:26.987368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:27.001107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 922/1816] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:27.996662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:27.998114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:28.016400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d59e8-4239-4361-87f9-1f7fec29ca2c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:28.022934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:28.024200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.024687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.025758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] PATH_INFO: `/v3/projects/b6213e314c364e2a83929af14f731bbe` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.028281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6213e314c364e2a83929af14f731bbe)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:28.030452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:28.131997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:28.134285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:28.147950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6213e314c364e2a83929af14f731bbe', 'request_id': 'req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.159478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be40bc5-705a-4569-9925-cec434559dc1 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:28.171907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:28.178926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6213e314c364e2a83929af14f731bbe', 'request_id': 'req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.199645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6213e314c364e2a83929af14f731bbe', 'request_id': 'req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.221848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] The token cache is being invalidate because project b6213e314c364e2a83929af14f731bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:28.222349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.225273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-3964cd36-6bdc-47dc-8824-b0d8b9e0bf40 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.227641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 895/1817] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:27 2022] DELETE /identity/v3/projects/b6213e314c364e2a83929af14f731bbe => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:28.233840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd48956-ca8e-4575-8d15-45e2b31a1ebf None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.234226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd48956-ca8e-4575-8d15-45e2b31a1ebf None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.235042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd48956-ca8e-4575-8d15-45e2b31a1ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.269411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-dbd48956-ca8e-4575-8d15-45e2b31a1ebf None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:28.270650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dbd48956-ca8e-4575-8d15-45e2b31a1ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:28.303025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:28.304085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.304512 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.304946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] PATH_INFO: `/v3/projects/b558c3982c664735a9b69c4203ec779d` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.308089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b558c3982c664735a9b69c4203ec779d)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:28.310377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:28.356391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 896/1818] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:28.358594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.358930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.359214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.391896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b558c3982c664735a9b69c4203ec779d', 'request_id': 'req-9d6b2341-6c14-496f-af46-8054b414f297'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.392669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:28.394609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:28.398481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b558c3982c664735a9b69c4203ec779d', 'request_id': 'req-9d6b2341-6c14-496f-af46-8054b414f297'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.413779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:28.422255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b558c3982c664735a9b69c4203ec779d', 'request_id': 'req-9d6b2341-6c14-496f-af46-8054b414f297'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.488519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] The token cache is being invalidate because project b558c3982c664735a9b69c4203ec779d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:28.488829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.489655 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.494755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 923/1819] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:28 2022] DELETE /identity/v3/projects/b558c3982c664735a9b69c4203ec779d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:28.496222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:28.497966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:28.531938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 897/1820] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:28.532861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:28.554237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884f3e40-4f6e-4cb9-afb6-42cbf7d72223 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:28.565011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:28.565762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.566414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.567081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.568210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:28.569022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:28.572512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:28.611485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 898/1821] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:28.614999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:28.631165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d94086-0bd1-4077-861f-84b45cf8d1eb admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:28.642441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6b2341-6c14-496f-af46-8054b414f297 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:28.646874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:28.647618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.648007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.648383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.649412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:28.652882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:28.658537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:28.659346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.659765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.660155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] PATH_INFO: `/v3/users/a074cab7761743f5abc0626037abf5a3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.663245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a074cab7761743f5abc0626037abf5a3)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:28.667810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:28.721946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 899/1822] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:28 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:28.725814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:28.746737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:28.759442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a074cab7761743f5abc0626037abf5a3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.763060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a074cab7761743f5abc0626037abf5a3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.792650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a074cab7761743f5abc0626037abf5a3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.807577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a074cab7761743f5abc0626037abf5a3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.818976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a074cab7761743f5abc0626037abf5a3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:28.820098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59c950-6b12-4462-a55b-779a3fb74bf8 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:28.827220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:28.828045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:28.828555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:28.828734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 924/1823] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:28 2022] DELETE /identity/v3/users/a074cab7761743f5abc0626037abf5a3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:28.828922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:28.829680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:28.831806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:28.867990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 900/1824] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:28 2022] POST /identity/v3/users => generated 293 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:28.872284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:28.877303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.010030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49c10ce-0bab-4374-a889-c4576cfb308b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.022275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.024168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.024588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.025562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.026542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.028402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.041459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 925/1825] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:29.048517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.060614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6197d7-3e23-4c5a-bc04-eb78245f601a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.070304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142204c1-2a6d-4391-81ed-1a36e9821d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.070966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142204c1-2a6d-4391-81ed-1a36e9821d7c admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.071321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142204c1-2a6d-4391-81ed-1a36e9821d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.072174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142204c1-2a6d-4391-81ed-1a36e9821d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.072856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142204c1-2a6d-4391-81ed-1a36e9821d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.075085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142204c1-2a6d-4391-81ed-1a36e9821d7c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.088792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 901/1826] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:29.093381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.106244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06632cd0-9084-4beb-b780-33ba33cbc460 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.111557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.112254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.112536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.112911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] PATH_INFO: `/v3/projects/44112b0addb64427b6ad32f1a2364878/users/58873f7b704c4094b86609fc9feef405/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.140046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44112b0addb64427b6ad32f1a2364878, user_id=58873f7b704c4094b86609fc9feef405, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.143573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.158344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 926/1827] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:29 2022] PUT /identity/v3/projects/44112b0addb64427b6ad32f1a2364878/users/58873f7b704c4094b86609fc9feef405/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:29.177706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.178224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.178683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.211719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] MFA Rules not processed for user `58873f7b704c4094b86609fc9feef405`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:29.213734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.225537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.228670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.344456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:29.350255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613c6c74-0fe8-44a0-8510-4affe582faa5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.356886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.357622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.358018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.358912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] PATH_INFO: `/v3/projects/772cc6c440814d62a80d5bdc1a7fbd2d` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.360198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] RBAC: Authorizing `identity:delete_project(project_id=772cc6c440814d62a80d5bdc1a7fbd2d)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.362300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.369950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 902/1828] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:29.374032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.397757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2bb21-b59f-446d-8557-8caaf1cd6d18 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.403214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.403835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.404120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.404397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.405039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.407522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.423497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:29.444545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '772cc6c440814d62a80d5bdc1a7fbd2d', 'request_id': 'req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:29.444823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 903/1829] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:29.449555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.457322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '772cc6c440814d62a80d5bdc1a7fbd2d', 'request_id': 'req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:29.469212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '772cc6c440814d62a80d5bdc1a7fbd2d', 'request_id': 'req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:29.495341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] The token cache is being invalidate because project 772cc6c440814d62a80d5bdc1a7fbd2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:29.495733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:29.497134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e953fe8d-ceb4-4bd7-989a-4ea1e54b155d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:29.502804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 927/1830] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:29 2022] DELETE /identity/v3/projects/772cc6c440814d62a80d5bdc1a7fbd2d => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:29.505308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f229a7-5bc9-4ddf-b634-624de287a27c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.505602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f229a7-5bc9-4ddf-b634-624de287a27c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.505907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f229a7-5bc9-4ddf-b634-624de287a27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.528919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d2f229a7-5bc9-4ddf-b634-624de287a27c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:29.530384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d2f229a7-5bc9-4ddf-b634-624de287a27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.562926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fd89de-7dde-4526-b3af-186d54938e13 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.569648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.570661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.571229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.571627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.572546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.574800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.602645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 904/1831] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/users => generated 294 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:29.607949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.609946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.623384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f402e462-ac74-43be-ba16-61a136a7b4af admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.628581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.629278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.629671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.630019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.630793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.632451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.636566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 928/1832] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:29.644332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 905/1833] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:29.646760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.647205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.647523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.648710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.660264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640e8d33-9f9f-4fc4-93cd-1af67f9f92dd admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.665173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.667025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.667376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.668253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.669460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.671765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.671888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:29.673589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.684949 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 929/1834] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:29.686077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 906/1835] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:29.690306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.692150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.701737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad38d4f8-321e-4f61-873d-19efe625156b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.706666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.707342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.707539 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db029834-95cd-4aa6-b0a8-5b761e158b54 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.707750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.708031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.708768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:29.709081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.710688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.712429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7c4cb3-ccb6-4013-bd30-cd3e07d64c49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.713357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4cb3-ccb6-4013-bd30-cd3e07d64c49 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.713638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4cb3-ccb6-4013-bd30-cd3e07d64c49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.713919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7c4cb3-ccb6-4013-bd30-cd3e07d64c49 admin admin] PATH_INFO: `/v3/projects/2216e0f1e3f94ca78b5111e77b91fe0b/users/aa273d03575a4b50b89306bb37298fea/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.726888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 930/1836] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:27:29.730262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.731898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c4cb3-ccb6-4013-bd30-cd3e07d64c49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2216e0f1e3f94ca78b5111e77b91fe0b, user_id=aa273d03575a4b50b89306bb37298fea, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.734816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7c4cb3-ccb6-4013-bd30-cd3e07d64c49 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.743520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26ec7b8-440c-463b-ae7a-3181184a9d4b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.749673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 907/1837] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:29 2022] PUT /identity/v3/projects/2216e0f1e3f94ca78b5111e77b91fe0b/users/aa273d03575a4b50b89306bb37298fea/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:29.760454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.760742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.761014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.793754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] MFA Rules not processed for user `aa273d03575a4b50b89306bb37298fea`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:29.794904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:29.817357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.819275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.820069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.820069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.821290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.825035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.863507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 931/1838] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/projects => generated 381 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:29.867472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.884791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 908/1839] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:29.886059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:29.896201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:29.903685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9d2aeb-61d2-48e9-8cb2-3f135f9c9557 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.906371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:29.953961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed689da-6df8-44bc-967c-b1de8d3708a5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:29.958839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.959565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.959946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.960300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.961011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.963628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.985746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:29.989418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 932/1840] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:29.989544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:29.989544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:29.989544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:29.989544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:29.990052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:29.990531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.001427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c13e3-3be7-4ac1-9fc0-17ca2bb4cb2d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.006236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.006885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.007324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.007641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.008300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.010596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.022743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 933/1841] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:30.027272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 909/1842] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:29 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:30.027421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.028225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.036317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e5577d-e603-41e3-9723-95acb83447aa admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.107365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08484f7-4f6b-4b63-8efa-253a9722198a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.128011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.128725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.129248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.129625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.129797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.130475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.132133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.132604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.133339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.133634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.134344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.136345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.152136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 934/1843] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:30.153890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.167779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835294f1-54e9-405d-9fb5-38700ddf37f9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.170738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 910/1844] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:30 2022] POST /identity/v3/users => generated 300 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:30.174094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.175864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acc6444-21b0-4d0f-a637-0c39fc645008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.176956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6444-21b0-4d0f-a637-0c39fc645008 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.176956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6444-21b0-4d0f-a637-0c39fc645008 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.177217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acc6444-21b0-4d0f-a637-0c39fc645008 admin admin] PATH_INFO: `/v3/projects/e408600bf54b441cb8eb037c15e6fb94/users/9ad03a3b41114f57b06b2111ce81a139/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.188094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56442735-189b-4094-a1eb-a798d1ed6fd5 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.193355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.194390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.194678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.194980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.195903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.197742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.199515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6444-21b0-4d0f-a637-0c39fc645008 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e408600bf54b441cb8eb037c15e6fb94, user_id=9ad03a3b41114f57b06b2111ce81a139, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.202909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acc6444-21b0-4d0f-a637-0c39fc645008 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.213266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 911/1845] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:30.217336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.228496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937dd240-b9af-44c8-b874-773f1d40e8b7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.250001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 935/1846] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:30 2022] PUT /identity/v3/projects/e408600bf54b441cb8eb037c15e6fb94/users/9ad03a3b41114f57b06b2111ce81a139/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:30.253788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.254015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.254313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.310861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] MFA Rules not processed for user `9ad03a3b41114f57b06b2111ce81a139`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:30.312191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:30.333132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.333826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.334113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.334390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] PATH_INFO: `/v3/projects/4d7fd220297943db8e728324f4a00949/users/4b139523482e43df93c1607ebb318592/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.348930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:30.352867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7fd220297943db8e728324f4a00949, user_id=4b139523482e43df93c1607ebb318592, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.357587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.382088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 912/1847] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:30 2022] PUT /identity/v3/projects/4d7fd220297943db8e728324f4a00949/users/4b139523482e43df93c1607ebb318592/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:30.385992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.455252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 936/1848] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:30.456660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.471051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc79da-0f98-47c4-8062-b686feca8cf0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.479683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:30.545256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41a16c-25a1-441b-b27c-ff7942fb18b7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.550806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.553244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.553746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.554103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.554331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.554876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.555218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.555496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.555702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.556743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.558460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.559046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.574871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 913/1849] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:30.579517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.591429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9238a373-f65c-4778-8d90-4e85bd199369 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.592387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 937/1850] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:30 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:30.596704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.670100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc377811-ba09-45c6-8356-c04042a3f244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.670952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377811-ba09-45c6-8356-c04042a3f244 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.671312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377811-ba09-45c6-8356-c04042a3f244 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.671511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc377811-ba09-45c6-8356-c04042a3f244 admin admin] PATH_INFO: `/v3/projects/4d7fd220297943db8e728324f4a00949/users/4b139523482e43df93c1607ebb318592/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.673606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc377811-ba09-45c6-8356-c04042a3f244 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d7fd220297943db8e728324f4a00949, user_id=4b139523482e43df93c1607ebb318592, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.676233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc377811-ba09-45c6-8356-c04042a3f244 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.676589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87668e88-15af-4f5b-befe-52c5dcfb5b2f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.681723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.682446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.682836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.683117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.683753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.685941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.687326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 914/1851] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:30 2022] PUT /identity/v3/projects/4d7fd220297943db8e728324f4a00949/users/4b139523482e43df93c1607ebb318592/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:30.700458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.700825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.701186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.708914 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 938/1852] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:30 2022] POST /identity/v3/users => generated 298 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:30.713651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.724019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52f0be-54d5-4335-9586-8a99373df50e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.739827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] MFA Rules not processed for user `4b139523482e43df93c1607ebb318592`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:30.740977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:30.787233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.788009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.788436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.788934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.789556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.791325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.802751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 939/1853] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:30.806666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.816779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b95766-6d1e-45e7-aba5-ebbcc3bcd185 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:30.825465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:30.826361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:30.826810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:30.827527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] PATH_INFO: `/v3/projects/3d2bcf715d8f430aa806555ef09220d6/users/7a7ea6a7aa5f420295165c5d33714c0b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:30.840455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 915/1854] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:30.858133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2bcf715d8f430aa806555ef09220d6, user_id=7a7ea6a7aa5f420295165c5d33714c0b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:30.861159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:30.864812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:30.866480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:30.872595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:30.879696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:30.901181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 940/1855] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:30 2022] PUT /identity/v3/projects/3d2bcf715d8f430aa806555ef09220d6/users/7a7ea6a7aa5f420295165c5d33714c0b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:30.905185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:31.063643 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f645244e-45cf-4f14-ad45-caea310f98e2 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:31.075919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbed5b7d-140c-4df6-ae89-6f2b27de98bb admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:31.081608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:31.082237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:31.082502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:31.082797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:31.083458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:31.086421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:31.099797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 941/1856] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:30 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:31.105047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:31.131317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc95a75-e5ca-4241-a9a6-bbafc86e66bd admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:31.137176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ecf8eb-68ac-4110-ab16-ba6d3500cdd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:31.137795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf8eb-68ac-4110-ab16-ba6d3500cdd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:31.138138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf8eb-68ac-4110-ab16-ba6d3500cdd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:31.138415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ecf8eb-68ac-4110-ab16-ba6d3500cdd2 admin admin] PATH_INFO: `/v3/projects/3d2bcf715d8f430aa806555ef09220d6/users/7a7ea6a7aa5f420295165c5d33714c0b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:31.140545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecf8eb-68ac-4110-ab16-ba6d3500cdd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2bcf715d8f430aa806555ef09220d6, user_id=7a7ea6a7aa5f420295165c5d33714c0b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:31.144248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ecf8eb-68ac-4110-ab16-ba6d3500cdd2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:31.167042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 942/1857] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:31 2022] PUT /identity/v3/projects/3d2bcf715d8f430aa806555ef09220d6/users/7a7ea6a7aa5f420295165c5d33714c0b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:31.175441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:31.175964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:31.176250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:31.202866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:31.203690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:31.204095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:31.204471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:31.209057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] MFA Rules not processed for user `7a7ea6a7aa5f420295165c5d33714c0b`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:31.210461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:31.308286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:31.309919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:31.325666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 943/1858] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:31 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:31.330933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 916/1859] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:31.338986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:31.340507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:31.351848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c0ee42-d4d5-4863-b8c6-581b4d7c839b service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:31.409306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e496d4ca-3a28-41ce-8ea9-2ebe7e98c086 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:31.410272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496d4ca-3a28-41ce-8ea9-2ebe7e98c086 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:31.410756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496d4ca-3a28-41ce-8ea9-2ebe7e98c086 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:31.411298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e496d4ca-3a28-41ce-8ea9-2ebe7e98c086 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:31.422208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496d4ca-3a28-41ce-8ea9-2ebe7e98c086 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:31.423801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e496d4ca-3a28-41ce-8ea9-2ebe7e98c086 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:31.445437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 917/1860] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:31 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:31.554620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:31.569105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7d7ff-5925-4bcd-8bba-0cd401b86a79 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:31.580395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01908e58-9b40-46ca-b126-fedb8df2af1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:31.581059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908e58-9b40-46ca-b126-fedb8df2af1b service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:31.581371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908e58-9b40-46ca-b126-fedb8df2af1b service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:31.581618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01908e58-9b40-46ca-b126-fedb8df2af1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:31.736155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01908e58-9b40-46ca-b126-fedb8df2af1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:31.737648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01908e58-9b40-46ca-b126-fedb8df2af1b service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:31.745641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:31.755458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 944/1861] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:32.022473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa0d0-7654-4282-8a8e-6eced508fbcb None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:32.023316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa0d0-7654-4282-8a8e-6eced508fbcb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:32.024173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8fa0d0-7654-4282-8a8e-6eced508fbcb None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:32.027585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 918/1862] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:27:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:27:32.063174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:32.063818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:32.064309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:32.138037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:32.140819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:32.371877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 945/1863] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:27:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:32.763465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fa0d0-7654-4282-8a8e-6eced508fbcb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:32.765966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0c8fa0d0-7654-4282-8a8e-6eced508fbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:32.833902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8fa0d0-7654-4282-8a8e-6eced508fbcb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:32.834177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:32.841286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:32.842785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:32.843417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:32.843417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:32.857151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:32.859749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:32.901321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 919/1864] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:32.902297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:32.907398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:32.917800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eebd57-fdcd-4500-893b-77f17f1de399 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:32.923454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:32.924570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:32.925120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:32.925539 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:32.930407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:32.987947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c6e16-6939-4049-8885-081f98339fc6 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:33.035505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:33.035505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:33.035505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:33.035979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] PATH_INFO: `/v3/users/9ad03a3b41114f57b06b2111ce81a139` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:33.037022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ad03a3b41114f57b06b2111ce81a139)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:33.039091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:33.090992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:33.092735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2696188-d787-4926-923b-38196a6e94bd service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:33.105683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 920/1865] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:33.164003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ad03a3b41114f57b06b2111ce81a139'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:33.165276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ad03a3b41114f57b06b2111ce81a139'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:33.190329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ad03a3b41114f57b06b2111ce81a139'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:33.209932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ad03a3b41114f57b06b2111ce81a139'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:33.243028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ad03a3b41114f57b06b2111ce81a139'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:33.257220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 946/1866] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:32 2022] DELETE /identity/v3/users/9ad03a3b41114f57b06b2111ce81a139 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:33.263058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:33.265169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:33.266484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:33.311831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:33.313221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:33.399489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 921/1867] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:33.446188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:33.452048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:33.508329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:33.598309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ff23e-a435-49ab-9159-4838086ffb92 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:33.604970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:33.605764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:33.606173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:33.606528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:33.631734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:33.637745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:33.665841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 947/1868] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:34.364040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:34.366652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:34.408212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6e697-2c67-4bb2-b0e8-595fd04f9d4a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:34.414571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:34.415490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:34.415761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:34.416045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] PATH_INFO: `/v3/projects/e408600bf54b441cb8eb037c15e6fb94` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:34.417229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e408600bf54b441cb8eb037c15e6fb94)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:34.419963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:34.493805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e408600bf54b441cb8eb037c15e6fb94', 'request_id': 'req-c98657b7-eebe-4e17-aa05-ae56e8e28c99'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.500457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e408600bf54b441cb8eb037c15e6fb94', 'request_id': 'req-c98657b7-eebe-4e17-aa05-ae56e8e28c99'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.509720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e408600bf54b441cb8eb037c15e6fb94', 'request_id': 'req-c98657b7-eebe-4e17-aa05-ae56e8e28c99'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.522074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] The token cache is being invalidate because project e408600bf54b441cb8eb037c15e6fb94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:34.522367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.523065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.525737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 922/1869] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:34 2022] DELETE /identity/v3/projects/e408600bf54b441cb8eb037c15e6fb94 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:34.530145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:34.542711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f93fc6-d07f-485d-a074-1c7c9562d5d9 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:34.612840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:34.613930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:34.614446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:34.614932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] PATH_INFO: `/v3/users/7a7ea6a7aa5f420295165c5d33714c0b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:34.616538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a7ea6a7aa5f420295165c5d33714c0b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:34.619642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:34.688266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a7ea6a7aa5f420295165c5d33714c0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.689017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a7ea6a7aa5f420295165c5d33714c0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.716506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a7ea6a7aa5f420295165c5d33714c0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.737944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a7ea6a7aa5f420295165c5d33714c0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.742493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5a2c32af-254d-4d52-9881-caa2e3f3272c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a7ea6a7aa5f420295165c5d33714c0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:34.764252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 948/1870] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:34 2022] DELETE /identity/v3/users/7a7ea6a7aa5f420295165c5d33714c0b => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:35.397030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:35.398566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:35.414771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98657b7-eebe-4e17-aa05-ae56e8e28c99 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:35.468398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:35.535159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:35.535879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:35.536230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:35.536595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] PATH_INFO: `/v3/projects/3d2bcf715d8f430aa806555ef09220d6` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:35.538505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2bcf715d8f430aa806555ef09220d6)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:35.540317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:35.597504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2bcf715d8f430aa806555ef09220d6', 'request_id': 'req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:35.607219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2bcf715d8f430aa806555ef09220d6', 'request_id': 'req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:35.616442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2bcf715d8f430aa806555ef09220d6', 'request_id': 'req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:35.631383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] The token cache is being invalidate because project 3d2bcf715d8f430aa806555ef09220d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:35.631678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:35.632369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-930a645d-ddf0-4ef3-b8cf-6a36424eb02f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:35.633888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 923/1871] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:35 2022] DELETE /identity/v3/projects/3d2bcf715d8f430aa806555ef09220d6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:35.641516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:35.642048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:35.642291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:35.667462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:35.669161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:35.704685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:35.767941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 949/1872] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:35.769879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:35.770236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:35.770438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:35.830368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:35.837565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:35.858068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 924/1873] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:35.860296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:35.877422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a73f7b-c37a-41b5-9051-1c6e50a9d4ab None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:35.901130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:35.901912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:35.902147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:35.902435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:35.903155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:35.903461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:35.912078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:35.934668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:35.935334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 950/1874] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:35.949189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26007a-1748-4d6a-a17d-35e6588847e4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:35.955138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:35.956280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:35.956662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:35.957042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:35.958212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:35.962999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:36.015327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 925/1875] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:35 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:36.018542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:36.032185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282db9-bd7b-4ae3-a1b4-5ab12bd535d2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:36.127939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:36.128872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:36.129445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:36.129868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:36.131286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:36.133591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:36.195839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 951/1876] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:36 2022] POST /identity/v3/users => generated 288 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:36.200644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:36.220875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc2ff7d-c8cf-4d3d-9dba-7bb16f346b81 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:36.237801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:36.238435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:36.238771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:36.239058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:36.239954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:36.241900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:36.266012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 926/1877] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:36.267069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:36.295880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b95025-052c-4146-a371-f32adb56e432 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:36.301645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b507a3-b190-4d4d-9468-657fbffd7619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:36.302601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b507a3-b190-4d4d-9468-657fbffd7619 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:36.303239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b507a3-b190-4d4d-9468-657fbffd7619 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:36.303625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b507a3-b190-4d4d-9468-657fbffd7619 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:36.304310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b507a3-b190-4d4d-9468-657fbffd7619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:36.306746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b507a3-b190-4d4d-9468-657fbffd7619 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:36.321354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 952/1878] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:36.326103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:36.336842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57835f9e-01cc-48bd-a7b7-90f30dd5d0b2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:36.345348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:36.346229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:36.346660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:36.347326 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] PATH_INFO: `/v3/projects/91b7eeab8fba41cca32eabf8a2d74218/users/88dc9f272b594571b7248b93e956dc5b/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:36.372018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=91b7eeab8fba41cca32eabf8a2d74218, user_id=88dc9f272b594571b7248b93e956dc5b, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:36.375600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:36.418820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 927/1879] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:36 2022] PUT /identity/v3/projects/91b7eeab8fba41cca32eabf8a2d74218/users/88dc9f272b594571b7248b93e956dc5b/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:36.420197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:36.420734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:36.421213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:36.507163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] MFA Rules not processed for user `88dc9f272b594571b7248b93e956dc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:36.508670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:36.661527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 953/1880] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:36.679236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:36.681427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:36.815043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b435ac-9ffd-476a-9afa-c018962ce8ec admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:36.819704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:36.820334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:36.820622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:36.820903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:36.832214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:36.835671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:36.838507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:36.854434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 928/1881] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:37.849303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:37.859882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d879a88b-fd49-4e85-9045-875d24460159 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:37.864848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:37.865604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:37.865991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:37.866873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:37.869552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:37.913001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:37.958938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:37.960605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:37.982822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 954/1882] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:37 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:40.786242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:40.787868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:40.878679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4740f33b-c92c-4d40-925f-37318233382c service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:40.904221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:40.909251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:40.909550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:40.909833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] PATH_INFO: `/v3/users/58873f7b704c4094b86609fc9feef405` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:40.912127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] RBAC: Authorizing `identity:delete_user(user_id=58873f7b704c4094b86609fc9feef405)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:40.914285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:40.961338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:40.963184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:40.979023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed80f1-3843-422a-b826-0a3998ac5fa4 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:40.986636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:40.987475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:40.987854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:40.988220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] PATH_INFO: `/v3/users/a86bfa213a8c40b486c502664c806752` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:40.989463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a86bfa213a8c40b486c502664c806752)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:40.990105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58873f7b704c4094b86609fc9feef405'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:40.991452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:41.015722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58873f7b704c4094b86609fc9feef405'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.027619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58873f7b704c4094b86609fc9feef405'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.028968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58873f7b704c4094b86609fc9feef405'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.037359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e64ed2e7-1fff-4608-94c6-76714cfe528f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58873f7b704c4094b86609fc9feef405'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.044958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 929/1883] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:40 2022] DELETE /identity/v3/users/58873f7b704c4094b86609fc9feef405 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:41.050265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:41.051044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:41.051638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:41.054837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a86bfa213a8c40b486c502664c806752'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.055692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a86bfa213a8c40b486c502664c806752'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.070409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a86bfa213a8c40b486c502664c806752'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.075770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:41.077205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:41.080288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a86bfa213a8c40b486c502664c806752'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.088742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3a1469db-8e08-4140-9372-b7fc89e6c595 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a86bfa213a8c40b486c502664c806752'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.099005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 955/1884] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:40 2022] DELETE /identity/v3/users/a86bfa213a8c40b486c502664c806752 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:41.104959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:41.105351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:41.105757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:41.133166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:41.135085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:41.152991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 930/1885] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:41.164437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:41.166430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:41.185241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:41.201680 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 956/1886] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:41.213337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:41.215768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:41.237598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d612dc0-8fa1-4d13-8510-e586e34d9fec None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:41.262679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:41.286761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ab2c1-eb47-4f26-9c91-279075d7d516 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:41.291847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:41.292817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:41.293105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:41.293383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:41.300310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:41.301089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:41.301529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:41.301811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:41.303460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:41.304896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:41.312947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:41.314357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:41.316336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 957/1887] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:41.325325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 931/1888] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:41.608593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:41.610819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:41.652952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064d3308-1a15-4432-924e-61eaffde22d4 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:41.658599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:41.659348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:41.659696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:41.660069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] PATH_INFO: `/v3/projects/6a884b0121dd4eeb874b9dd85b55c053` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:41.661542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a884b0121dd4eeb874b9dd85b55c053)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:41.663628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:41.753855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a884b0121dd4eeb874b9dd85b55c053', 'request_id': 'req-6f132722-356f-40ba-ac7d-57f4cbc8231a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.770101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a884b0121dd4eeb874b9dd85b55c053', 'request_id': 'req-6f132722-356f-40ba-ac7d-57f4cbc8231a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.791442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a884b0121dd4eeb874b9dd85b55c053', 'request_id': 'req-6f132722-356f-40ba-ac7d-57f4cbc8231a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.815586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] The token cache is being invalidate because project 6a884b0121dd4eeb874b9dd85b55c053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:41.816225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.818395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:41.820347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 958/1889] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:41 2022] DELETE /identity/v3/projects/6a884b0121dd4eeb874b9dd85b55c053 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:41.825169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:41.836787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9a4c16-0652-4278-b210-cd554df71622 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:41.910886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:41.911800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:41.912311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:41.912756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] PATH_INFO: `/v3/users/ff0829ae7ef043fc8575d021688e9add` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:41.914497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff0829ae7ef043fc8575d021688e9add)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:41.918884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:41.959634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:41.960749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:41.984611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132722-356f-40ba-ac7d-57f4cbc8231a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:41.998483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:42.000681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:42.002693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:42.005007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] PATH_INFO: `/v3/projects/44112b0addb64427b6ad32f1a2364878` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:42.010886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44112b0addb64427b6ad32f1a2364878)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:42.013980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:42.019969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff0829ae7ef043fc8575d021688e9add'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.050578 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff0829ae7ef043fc8575d021688e9add'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.077638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff0829ae7ef043fc8575d021688e9add'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.078507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff0829ae7ef043fc8575d021688e9add'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.082131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:42.090188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff0829ae7ef043fc8575d021688e9add'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.106744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 932/1890] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:41 2022] DELETE /identity/v3/users/ff0829ae7ef043fc8575d021688e9add => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:42.126750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44112b0addb64427b6ad32f1a2364878', 'request_id': 'req-ba5f18ce-d04c-4ee4-af89-146d0bf09833'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.135177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44112b0addb64427b6ad32f1a2364878', 'request_id': 'req-ba5f18ce-d04c-4ee4-af89-146d0bf09833'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.151610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44112b0addb64427b6ad32f1a2364878', 'request_id': 'req-ba5f18ce-d04c-4ee4-af89-146d0bf09833'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.165843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] The token cache is being invalidate because project 44112b0addb64427b6ad32f1a2364878 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:42.166345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.167052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.168651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 959/1891] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:41 2022] DELETE /identity/v3/projects/44112b0addb64427b6ad32f1a2364878 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:42.174772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:42.176329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:42.273467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb47732-a6f8-4271-922d-3e1762b8b559 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:42.295574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:42.296444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:42.296833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:42.297596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] PATH_INFO: `/v3/users/aa273d03575a4b50b89306bb37298fea` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:42.298614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa273d03575a4b50b89306bb37298fea)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:42.300822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:42.399335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa273d03575a4b50b89306bb37298fea'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.418695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa273d03575a4b50b89306bb37298fea'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.430410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa273d03575a4b50b89306bb37298fea'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.431263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa273d03575a4b50b89306bb37298fea'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.442845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-100661af-9f65-4894-8f62-8fe8c731f35c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa273d03575a4b50b89306bb37298fea'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.451701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 933/1892] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:42 2022] DELETE /identity/v3/users/aa273d03575a4b50b89306bb37298fea => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:42.596724 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:42.598246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:42.723389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:42.744529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5f18ce-d04c-4ee4-af89-146d0bf09833 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:42.843515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:42.844448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:42.845025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:42.845499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] PATH_INFO: `/v3/projects/19e4de9dc63f4e77904e434999666f21` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:42.847100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19e4de9dc63f4e77904e434999666f21)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:42.849461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:42.934138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19e4de9dc63f4e77904e434999666f21', 'request_id': 'req-00639a4c-e148-4156-bfb2-a6362b500596'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.941077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19e4de9dc63f4e77904e434999666f21', 'request_id': 'req-00639a4c-e148-4156-bfb2-a6362b500596'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.951209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19e4de9dc63f4e77904e434999666f21', 'request_id': 'req-00639a4c-e148-4156-bfb2-a6362b500596'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.969681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] The token cache is being invalidate because project 19e4de9dc63f4e77904e434999666f21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:42.970235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.971111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00639a4c-e148-4156-bfb2-a6362b500596 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:42.977137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 960/1893] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:42 2022] DELETE /identity/v3/projects/19e4de9dc63f4e77904e434999666f21 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:42.979394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:42.979839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:42.979976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.011679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:43.013001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:43.086313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 934/1894] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:43.095759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.096273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.096352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.118923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:43.120375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:43.136176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.146696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e617ba-2904-42b4-8e99-888caad0b9b7 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.147362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 961/1895] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:43.153525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.154313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.154956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.155562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.156410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:43.157306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.159350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.169674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:43.184672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.191361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 935/1896] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:43.195428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73c128-dfbf-476d-a900-7678a01203e7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.202461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.203270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.203792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.204170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.205064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.207567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.252499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.264606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139fa18-36a4-42a7-805f-0ec044f9300e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.265010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 962/1897] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:43 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:43.409273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.411383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:43.500580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.501212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.501497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.501772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.511887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.511887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.554758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 936/1898] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:43 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:43.556850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.574032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527e9733-987c-4c77-96c0-42b6513fc375 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.597887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.598537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.598886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.600842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.602099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.603986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:43.606564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.614049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe992fb4-8d58-450d-a8d9-705da592cdd4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.627424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 937/1899] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:43.628702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.630411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.631161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.631393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.631679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] PATH_INFO: `/v3/projects/2216e0f1e3f94ca78b5111e77b91fe0b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.632906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2216e0f1e3f94ca78b5111e77b91fe0b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.635623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.642564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0903-a864-4ce2-b9ab-a6a5f2942419 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.647901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.649798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.649798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.650789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.651803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.655707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.674209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 938/1900] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:43.675318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.691240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf7013-3488-4985-ad8e-40c63c51bb3f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:43.703857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444d169-3e1a-4ab3-ab81-87ae8252bf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:43.706694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444d169-3e1a-4ab3-ab81-87ae8252bf8b admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.707216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444d169-3e1a-4ab3-ab81-87ae8252bf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.707694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444d169-3e1a-4ab3-ab81-87ae8252bf8b admin admin] PATH_INFO: `/v3/projects/4cbcd5444c454b1285962e2c81ced0d5/users/8d542c184bf443f0b9a591e882904e0b/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.741356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444d169-3e1a-4ab3-ab81-87ae8252bf8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cbcd5444c454b1285962e2c81ced0d5, user_id=8d542c184bf443f0b9a591e882904e0b, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:43.745070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444d169-3e1a-4ab3-ab81-87ae8252bf8b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:43.746369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2216e0f1e3f94ca78b5111e77b91fe0b', 'request_id': 'req-caabc4e4-a46b-4dea-8e90-af4d5eff1026'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:43.758211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2216e0f1e3f94ca78b5111e77b91fe0b', 'request_id': 'req-caabc4e4-a46b-4dea-8e90-af4d5eff1026'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:43.777215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2216e0f1e3f94ca78b5111e77b91fe0b', 'request_id': 'req-caabc4e4-a46b-4dea-8e90-af4d5eff1026'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:43.777526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 939/1901] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:43 2022] PUT /identity/v3/projects/4cbcd5444c454b1285962e2c81ced0d5/users/8d542c184bf443f0b9a591e882904e0b/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:43.785878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:43.786196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:43.786505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:43.800171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] The token cache is being invalidate because project 2216e0f1e3f94ca78b5111e77b91fe0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:43.800514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:43.804725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:43.810058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 963/1902] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:43 2022] DELETE /identity/v3/projects/2216e0f1e3f94ca78b5111e77b91fe0b => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:43.811202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:43.812760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:43.846213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] MFA Rules not processed for user `8d542c184bf443f0b9a591e882904e0b`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:43.849121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:43.980998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabc4e4-a46b-4dea-8e90-af4d5eff1026 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.029093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 940/1903] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:44.033232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:44.034859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:44.109687 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:44.125776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.126932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.127548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.127847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] PATH_INFO: `/v3/users/4b139523482e43df93c1607ebb318592` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.132918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b139523482e43df93c1607ebb318592)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.135713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.184546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90cd1b-3489-45a5-9774-94bd56f47aa0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.221294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.221294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.221294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.221294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.221715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.221715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.237208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:44.253080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b139523482e43df93c1607ebb318592'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:44.254635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b139523482e43df93c1607ebb318592'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:44.271634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b139523482e43df93c1607ebb318592'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:44.276301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 941/1904] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:44 2022] POST /identity/v3/projects => generated 371 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:44.279579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:44.310439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b139523482e43df93c1607ebb318592'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:44.321009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b139523482e43df93c1607ebb318592'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:44.334647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 964/1905] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:43 2022] DELETE /identity/v3/users/4b139523482e43df93c1607ebb318592 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:44.407587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0343f2-52c3-4baa-8c88-017748284982 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.535211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.535967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.536262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.536629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.563308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.582059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.635425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 942/1906] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:44 2022] POST /identity/v3/users => generated 292 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:44.636959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:44.638780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:44.660111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bb27ae-1b59-485e-a946-3e90550ce5b1 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.666353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.667321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.667793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.668269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.669103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.672101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.694498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 965/1907] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:44.694974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:44.710563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758bc1d5-e595-499e-9ceb-05d829d857f0 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.723292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.724052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.724338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.724622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] PATH_INFO: `/v3/projects/bccd058cdd0f4664aaa1990b10e34f28/users/32d50f6a01e44d10b2171e3de48a9cbd/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.754407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccd058cdd0f4664aaa1990b10e34f28, user_id=32d50f6a01e44d10b2171e3de48a9cbd, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.757153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.774654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 943/1908] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:44 2022] PUT /identity/v3/projects/bccd058cdd0f4664aaa1990b10e34f28/users/32d50f6a01e44d10b2171e3de48a9cbd/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:44.778980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:44.791865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61996e5b-7e0a-473d-be2f-51989ce5bb37 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.901317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96ecb9e-e8fc-4e3e-8413-98c7c5692c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.902212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ecb9e-e8fc-4e3e-8413-98c7c5692c34 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.902697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ecb9e-e8fc-4e3e-8413-98c7c5692c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.903219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96ecb9e-e8fc-4e3e-8413-98c7c5692c34 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.904070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ecb9e-e8fc-4e3e-8413-98c7c5692c34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.906400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96ecb9e-e8fc-4e3e-8413-98c7c5692c34 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.920342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 966/1909] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:44.924492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:44.936635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb847c-1add-49b9-a61b-cd67aebe1962 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:44.942060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:44.942776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.943435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.943435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] PATH_INFO: `/v3/projects/bccd058cdd0f4664aaa1990b10e34f28/users/32d50f6a01e44d10b2171e3de48a9cbd/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:44.945284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bccd058cdd0f4664aaa1990b10e34f28, user_id=32d50f6a01e44d10b2171e3de48a9cbd, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:44.948804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:44.963369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 944/1910] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:44 2022] PUT /identity/v3/projects/bccd058cdd0f4664aaa1990b10e34f28/users/32d50f6a01e44d10b2171e3de48a9cbd/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:44.973766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2321-a336-402b-9bf8-8416845815cb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:44.974058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2321-a336-402b-9bf8-8416845815cb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:44.974340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642c2321-a336-402b-9bf8-8416845815cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.043921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-642c2321-a336-402b-9bf8-8416845815cb None None] MFA Rules not processed for user `32d50f6a01e44d10b2171e3de48a9cbd`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:45.045995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-642c2321-a336-402b-9bf8-8416845815cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:45.199752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 967/1911] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:44 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:45.214200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:45.215414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:45.221356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2321-a336-402b-9bf8-8416845815cb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:45.223653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-642c2321-a336-402b-9bf8-8416845815cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:45.271233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:45.321802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:45.382828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642c2321-a336-402b-9bf8-8416845815cb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:45.389289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5f909-6853-4b96-ab62-da7ad577963d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:45.390112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f909-6853-4b96-ab62-da7ad577963d service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:45.390459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f909-6853-4b96-ab62-da7ad577963d service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:45.390839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5f909-6853-4b96-ab62-da7ad577963d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.403646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4e67ce-7871-41e3-80a4-dff7886018b1 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:45.405463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5f909-6853-4b96-ab62-da7ad577963d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:45.408633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5f909-6853-4b96-ab62-da7ad577963d service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:45.410392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:45.411814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:45.412173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:45.412517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] PATH_INFO: `/v3/projects/4d7fd220297943db8e728324f4a00949` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.414346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d7fd220297943db8e728324f4a00949)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:45.417538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:45.438766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 968/1912] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:45.500477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d7fd220297943db8e728324f4a00949', 'request_id': 'req-b9f418dc-6f48-44aa-943e-8aaee6649d17'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:45.516025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d7fd220297943db8e728324f4a00949', 'request_id': 'req-b9f418dc-6f48-44aa-943e-8aaee6649d17'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:45.532719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d7fd220297943db8e728324f4a00949', 'request_id': 'req-b9f418dc-6f48-44aa-943e-8aaee6649d17'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:45.553892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] The token cache is being invalidate because project 4d7fd220297943db8e728324f4a00949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:45.554208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:45.555452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b9f418dc-6f48-44aa-943e-8aaee6649d17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:45.567337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 945/1913] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:45 2022] DELETE /identity/v3/projects/4d7fd220297943db8e728324f4a00949 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:45.574158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:45.574493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:45.574788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.601772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:45.603072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:45.747941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 969/1914] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:45.755686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:45.755972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:45.756250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.810241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:45.812249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:45.831648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 946/1915] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:45.836506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:45.855573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253afcb-28e4-4d60-9146-1af6c345f1ac None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:45.879425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:45.880063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:45.880375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:45.880597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.881265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:45.881570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:45.883504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:45.929657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 970/1916] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:27:45.931354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:45.946462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaca5ba-6575-473d-b3dc-bb14f8ccf40c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:45.955971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:45.956611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:45.956900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:45.967472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:45.967472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:45.968755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:46.043781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 947/1917] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:45 2022] POST /identity/v3/projects => generated 399 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:46.048059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:46.061876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4042b90-2f5a-4d53-97cf-985f8fcd6907 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:46.223583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:46.224299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.224299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.224432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.225421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:46.232741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:46.325632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 971/1918] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:46 2022] POST /identity/v3/users => generated 300 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:46.329737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:46.346889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b2dc3e-6efd-4d41-8ef0-de776762982d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:46.359448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:46.360190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.361716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.362009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.362680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:46.366442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:46.388152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:46.390008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:46.406028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 948/1919] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:46.409874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092fe4f-b296-4c62-8b26-92ada67846ae admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:46.423563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:46.445725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:46.447577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.455989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.458765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] PATH_INFO: `/v3/users/8d542c184bf443f0b9a591e882904e0b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.465342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d542c184bf443f0b9a591e882904e0b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:46.468566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecaa528-ffe9-40c8-9d57-90cae9caeae7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:46.477543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:46.477981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:46.478402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.478876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.479163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.479857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:46.483254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:46.501914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 949/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:46.506622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:46.533224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a77ce7-fa25-4156-9631-23994a3f912b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:46.553374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d1f01e-d327-4119-bb1e-4dba1291fa1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:46.554056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1f01e-d327-4119-bb1e-4dba1291fa1f admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.554336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1f01e-d327-4119-bb1e-4dba1291fa1f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.554610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d1f01e-d327-4119-bb1e-4dba1291fa1f admin admin] PATH_INFO: `/v3/projects/e76ac6ab5ec54d14a3bda2ee6861e1cf/users/96729875839048eb951a08c3f3659787/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.590462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1f01e-d327-4119-bb1e-4dba1291fa1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76ac6ab5ec54d14a3bda2ee6861e1cf, user_id=96729875839048eb951a08c3f3659787, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:46.592826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d1f01e-d327-4119-bb1e-4dba1291fa1f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:46.620602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 950/1921] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:46 2022] PUT /identity/v3/projects/e76ac6ab5ec54d14a3bda2ee6861e1cf/users/96729875839048eb951a08c3f3659787/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:46.622375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:46.635917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.636479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.636952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.654560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d542c184bf443f0b9a591e882904e0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:46.655732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d542c184bf443f0b9a591e882904e0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:46.703412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d542c184bf443f0b9a591e882904e0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:46.720093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] MFA Rules not processed for user `96729875839048eb951a08c3f3659787`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:46.721648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:46.723641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d542c184bf443f0b9a591e882904e0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:46.738166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4d8ae035-01e3-4237-8caf-559bc4dbe893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d542c184bf443f0b9a591e882904e0b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:46.758178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 972/1922] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:46 2022] DELETE /identity/v3/users/8d542c184bf443f0b9a591e882904e0b => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:46.760069 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:46.760939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:46.766738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:46.783300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:46.848829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:46.855125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:46.896781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 951/1923] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:46.901771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:46.904514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:46.992583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 973/1924] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:47.039138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.041176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d700e0e9-dcad-41cb-8836-915c1d0d6981 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.042221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:47.051534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.052459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.054816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.055220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.056607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.061232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.116283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 952/1925] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:46 2022] POST /identity/v3/projects => generated 401 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:47.120237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.160479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce58160-949d-44af-b207-2c4dfcfdf654 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.212444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d1638-a907-4553-8696-9a786e97c4ae admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.217632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.218455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.218909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.219372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.220138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.222201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.243868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.244899 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.245199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.245530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.252732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 953/1926] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:47 2022] POST /identity/v3/users => generated 307 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:47.255019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.257039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.258504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.267800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf06d1d3-7573-4f0a-b05c-8c3fa7bce2ae admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.272715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.273377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.273492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 974/1927] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:47.273615 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.273947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.275513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.277140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.294744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 954/1928] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:47.297594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.308356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9ad96-25ee-445b-802e-1e5e878aa978 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.313970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.314653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.314970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.315509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] PATH_INFO: `/v3/projects/75f7a2171393492e993c2e15703c5816/users/e610e813fabc4c25be3d51ad15ad187a/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.331917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:47.337817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f7a2171393492e993c2e15703c5816, user_id=e610e813fabc4c25be3d51ad15ad187a, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.340644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.365023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 975/1929] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:47 2022] PUT /identity/v3/projects/75f7a2171393492e993c2e15703c5816/users/e610e813fabc4c25be3d51ad15ad187a/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:47.366560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.382066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd724-de75-4b16-b6fa-1058a92fad2e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.420071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:47.487030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20ad5e-440e-4f62-836d-eae5deed762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.487909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20ad5e-440e-4f62-836d-eae5deed762d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.488241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20ad5e-440e-4f62-836d-eae5deed762d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.488766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20ad5e-440e-4f62-836d-eae5deed762d admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.489677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20ad5e-440e-4f62-836d-eae5deed762d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.494731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20ad5e-440e-4f62-836d-eae5deed762d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.522388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 955/1930] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:47.523664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.541133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f66ca-3f49-4fd5-973f-e0cb6f2697c8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.549392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.550235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.551323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.551682 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] PATH_INFO: `/v3/projects/75f7a2171393492e993c2e15703c5816/users/e610e813fabc4c25be3d51ad15ad187a/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.553946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] RBAC: Authorizing `identity:create_grant(project_id=75f7a2171393492e993c2e15703c5816, user_id=e610e813fabc4c25be3d51ad15ad187a, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.559553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.575254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 976/1931] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:47 2022] PUT /identity/v3/projects/75f7a2171393492e993c2e15703c5816/users/e610e813fabc4c25be3d51ad15ad187a/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:47.590599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.591680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.591965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.632562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] MFA Rules not processed for user `e610e813fabc4c25be3d51ad15ad187a`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:47.634536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:47.697987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.700096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:47.737536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 956/1932] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:47 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:47.750298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.752071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:47.796377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90c8e5-1ba1-41bd-80f1-84286e57203a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.801458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.802111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.802395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.802751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] PATH_INFO: `/v3/projects/4cbcd5444c454b1285962e2c81ced0d5` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.803901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cbcd5444c454b1285962e2c81ced0d5)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.806450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.829112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07a59fa-96bf-4423-be3a-8a432f7e3d02 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.833565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:47.834190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:47.834471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:47.834841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:47.847187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:47.851037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:47.867390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 957/1933] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:47 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:47.870212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cbcd5444c454b1285962e2c81ced0d5', 'request_id': 'req-42426bd5-c532-4e37-a747-787bb3cd6dd8'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:47.876987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cbcd5444c454b1285962e2c81ced0d5', 'request_id': 'req-42426bd5-c532-4e37-a747-787bb3cd6dd8'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:47.886794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cbcd5444c454b1285962e2c81ced0d5', 'request_id': 'req-42426bd5-c532-4e37-a747-787bb3cd6dd8'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:47.901229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] The token cache is being invalidate because project 4cbcd5444c454b1285962e2c81ced0d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:47.901530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:47.902222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:47.904287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 977/1934] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:47 2022] DELETE /identity/v3/projects/4cbcd5444c454b1285962e2c81ced0d5 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:47.908309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.922335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b55cab9-af9d-45f3-82f7-94af0ef9d7ac service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:47.984564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:47.986104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:48.008426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:48.022489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:48.023194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:48.023636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:48.024771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] PATH_INFO: `/v3/users/32d50f6a01e44d10b2171e3de48a9cbd` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:48.026024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] RBAC: Authorizing `identity:delete_user(user_id=32d50f6a01e44d10b2171e3de48a9cbd)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:48.028035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:48.090344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42426bd5-c532-4e37-a747-787bb3cd6dd8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:48.098406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:48.099475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:48.100329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:48.100929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:48.102764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32d50f6a01e44d10b2171e3de48a9cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:48.103360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:48.121178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32d50f6a01e44d10b2171e3de48a9cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:48.132976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32d50f6a01e44d10b2171e3de48a9cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:48.133137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:48.133799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32d50f6a01e44d10b2171e3de48a9cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:48.143688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32d50f6a01e44d10b2171e3de48a9cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:48.153043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 958/1935] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:47 2022] DELETE /identity/v3/users/32d50f6a01e44d10b2171e3de48a9cbd => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:48.222157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:48.224333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090a426f-8699-46e8-a2cf-f13659d51643 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:48.257691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 978/1936] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:48.825182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:48.826831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:48.977712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0878c42-0cd3-43ef-b6d6-226d7f82d80e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:48.984011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:48.984882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:48.985178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:48.985452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] PATH_INFO: `/v3/projects/bccd058cdd0f4664aaa1990b10e34f28` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:48.986899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bccd058cdd0f4664aaa1990b10e34f28)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:48.989111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.075927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bccd058cdd0f4664aaa1990b10e34f28', 'request_id': 'req-4d41f738-efa0-4477-bd69-d1e2a00ff60b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:49.085575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bccd058cdd0f4664aaa1990b10e34f28', 'request_id': 'req-4d41f738-efa0-4477-bd69-d1e2a00ff60b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:49.097689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bccd058cdd0f4664aaa1990b10e34f28', 'request_id': 'req-4d41f738-efa0-4477-bd69-d1e2a00ff60b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:49.108271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:49.116345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] The token cache is being invalidate because project bccd058cdd0f4664aaa1990b10e34f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:49.116915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:49.119676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4d41f738-efa0-4477-bd69-d1e2a00ff60b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:49.126496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 959/1937] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:48 2022] DELETE /identity/v3/projects/bccd058cdd0f4664aaa1990b10e34f28 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:49.130826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.131867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.132386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.159931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:49.161324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:49.232718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 979/1938] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:49.240811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.241103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.241380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.270628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:49.272234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:49.283413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 960/1939] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:49.292787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.305943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0a56a-b63f-4fda-ad4e-1366bcb8765c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.312135 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.313073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.313460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.313892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.314657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:49.315213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.316911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.332047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 980/1940] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:27:49.338367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.351998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ec0fc-1a52-498c-8eec-a510577c9073 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.357321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.357929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.358207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.358482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.359141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.361509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.394358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 961/1941] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/projects => generated 365 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:49.397110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.410260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed58c6d1-a1b8-4ace-83d7-38155b955f2a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.479487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.480227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.480585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.480958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.481674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.483802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.511180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 981/1942] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/users => generated 283 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:49.512441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.523481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4980b4c5-46ec-4ee9-bf0b-4ea8fc110a96 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.529380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.530036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.530304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.530583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.531284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.532906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.546799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 962/1943] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:49.548590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.559778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf701f-eaa3-43b8-9cb4-c033e4824da2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.564496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f7644d-5759-4569-b59d-2de3c2eb064f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.565124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7644d-5759-4569-b59d-2de3c2eb064f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.565415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7644d-5759-4569-b59d-2de3c2eb064f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.565688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f7644d-5759-4569-b59d-2de3c2eb064f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.566348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7644d-5759-4569-b59d-2de3c2eb064f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.568017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f7644d-5759-4569-b59d-2de3c2eb064f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.579676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 982/1944] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:49.583809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.594528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ac6f1-a0f4-417c-8d9e-963fa8a5d5a8 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.599223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.600237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.600237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.600502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] PATH_INFO: `/v3/projects/bd52d4519cf540ebbddc02d0d0171592/users/6de66c50b9b54fe99e7b3edeb6fb69d4/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.616676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd52d4519cf540ebbddc02d0d0171592, user_id=6de66c50b9b54fe99e7b3edeb6fb69d4, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.621353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.637658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 963/1945] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:49 2022] PUT /identity/v3/projects/bd52d4519cf540ebbddc02d0d0171592/users/6de66c50b9b54fe99e7b3edeb6fb69d4/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:49.647760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.647760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.647760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.681713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] MFA Rules not processed for user `6de66c50b9b54fe99e7b3edeb6fb69d4`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:49.683138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:49.703497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:49.782834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 983/1946] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:49.786967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.906155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d428a6-e2b5-4f28-bb17-bd452a5a2aa2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:49.911019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:49.912142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:49.912507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:49.912855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:49.913512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:49.916281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:49.951650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 964/1947] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:49.955374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:49.968421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393de4f1-46cb-402f-ae71-45f808bbd7c4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.033917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.034593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.035818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.035818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.036027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.038427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.063041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 984/1948] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:49 2022] POST /identity/v3/users => generated 289 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:50.067057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.088715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08872fd-eba8-4591-8e3d-274516f5443c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.094598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.095433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.096929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.099842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.100659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.101041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.103632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.103837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.117028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75b40fe-b173-4da9-a4eb-a0ea8991e1d4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.122820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 965/1949] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:50.126664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.127789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.128124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.128530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] PATH_INFO: `/v3/users/88dc9f272b594571b7248b93e956dc5b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.129871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88dc9f272b594571b7248b93e956dc5b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.131947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.136203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.152674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf210e6-90df-4aed-acc8-b9b8917f39a9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.158675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.159801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.159970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.160392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] PATH_INFO: `/v3/projects/eb10aabc831f401a9f719ad139a22bc4/users/aed7be1ec10444b0a93be445b3c35446/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.186556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb10aabc831f401a9f719ad139a22bc4, user_id=aed7be1ec10444b0a93be445b3c35446, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.190322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.209624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 966/1950] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:50 2022] PUT /identity/v3/projects/eb10aabc831f401a9f719ad139a22bc4/users/aed7be1ec10444b0a93be445b3c35446/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:50.214660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.240332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88dc9f272b594571b7248b93e956dc5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:50.241819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88dc9f272b594571b7248b93e956dc5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:50.261013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88dc9f272b594571b7248b93e956dc5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:50.270537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88dc9f272b594571b7248b93e956dc5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:50.282399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:50.289068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b200a98f-e257-4f11-9b1d-7de9dd70aee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88dc9f272b594571b7248b93e956dc5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:50.295046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 985/1951] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:50 2022] DELETE /identity/v3/users/88dc9f272b594571b7248b93e956dc5b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:50.306753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.306753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.306753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.312371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb03eb7-e37b-4056-a7ca-d329d27fb61e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.340340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:50.341844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.359841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:50.401019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.401634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.401910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.402202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.402940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.404481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.412614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 986/1952] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:50.413623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.416892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.420199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 967/1953] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:50 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:50.421075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.422855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.436930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfbd96-4d71-434a-aafc-4ab074ff466e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.443295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.443970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.444255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.444537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] PATH_INFO: `/v3/projects/eb10aabc831f401a9f719ad139a22bc4/users/aed7be1ec10444b0a93be445b3c35446/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.447662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb10aabc831f401a9f719ad139a22bc4, user_id=aed7be1ec10444b0a93be445b3c35446, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.450116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.465064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 968/1954] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:50 2022] PUT /identity/v3/projects/eb10aabc831f401a9f719ad139a22bc4/users/aed7be1ec10444b0a93be445b3c35446/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:50.477724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.477724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.502381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1e2888-dcee-4103-9f1a-92cc07f24dbe None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.563848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a454a739-c446-47a0-9b2b-3d6bacf0bedf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.569931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.570093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.570258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.570534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.573232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.580430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.581641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.582836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.583293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.653592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.655062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69090f93-4a38-4842-86a5-089e5f56e91c service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.666673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 987/1955] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:50 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:50.668004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.668291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.668644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.675191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.678426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.695927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 969/1956] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:50.703759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] MFA Rules not processed for user `aed7be1ec10444b0a93be445b3c35446`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:50.705034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:50.720572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:50.787775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 988/1957] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:50 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:50.802692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:50.813771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daa145b-8cdc-4c0e-9b9a-ba5c4143b190 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:50.818605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:50.819334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:50.819690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:50.820793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:50.836895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:50.838806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:50.859692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 970/1958] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:50 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:51.033025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.035399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:51.053904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95587646-f721-491c-8d6d-a15214d10dfd None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.058920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.059700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.059951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.060441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.062511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:51.172667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.174998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a83fc0-312d-4159-9ea2-2a84bde0a1f0 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.198493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.200383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:51.208648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 989/1959] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:51.231097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789396c-19c2-4508-a76b-614f90afbb11 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.252642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.253329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.253647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.254372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] PATH_INFO: `/v3/projects/91b7eeab8fba41cca32eabf8a2d74218` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.255875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91b7eeab8fba41cca32eabf8a2d74218)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.260523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.271212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:51.352012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91b7eeab8fba41cca32eabf8a2d74218', 'request_id': 'req-70219796-1cf2-4c0f-b1a5-09983b8bb178'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:51.359602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91b7eeab8fba41cca32eabf8a2d74218', 'request_id': 'req-70219796-1cf2-4c0f-b1a5-09983b8bb178'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:51.368827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91b7eeab8fba41cca32eabf8a2d74218', 'request_id': 'req-70219796-1cf2-4c0f-b1a5-09983b8bb178'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:51.385324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] The token cache is being invalidate because project 91b7eeab8fba41cca32eabf8a2d74218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:51.385891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:51.386986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70219796-1cf2-4c0f-b1a5-09983b8bb178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:51.393429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 971/1960] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:51 2022] DELETE /identity/v3/projects/91b7eeab8fba41cca32eabf8a2d74218 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:51.393795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.394221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.394401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.434317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:51.434797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:51.557936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 990/1961] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:51.559899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.560045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.560218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.581938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:51.583234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:51.592925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 972/1962] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:51.597203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.608831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab926d0-133c-4a4b-9c67-f1a18b54bc8e None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.616322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.616966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.617249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.617563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.619066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:51.619704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.621907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.646763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 991/1963] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:51.650458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.662974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a29c11-e3a5-4647-b263-bbef1de2cd08 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.670385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.671442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.672143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.673047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.674173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.677265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.724563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 973/1964] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:51 2022] POST /identity/v3/projects => generated 373 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:27:51.729017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.740985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292d2e3e-d574-42c4-900b-d404355288f9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.783234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:51.820912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.822845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.823217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.823587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.836291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.836291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.852013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 992/1965] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:51 2022] POST /identity/v3/users => generated 287 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:51.857266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.868720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7663fbee-da1c-4dc8-89e9-59d21fc0f559 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.874038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.874657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.874982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.875265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.875920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.877553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.889151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 974/1966] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:51.893445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.905633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7536837-cf38-4d95-bff8-449bd3d63614 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.915172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9141a-4b44-4f0f-8f00-a9fa27294911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.916091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9141a-4b44-4f0f-8f00-a9fa27294911 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.916496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9141a-4b44-4f0f-8f00-a9fa27294911 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.916742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9141a-4b44-4f0f-8f00-a9fa27294911 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.917391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9141a-4b44-4f0f-8f00-a9fa27294911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.919375 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9141a-4b44-4f0f-8f00-a9fa27294911 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:51.933661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 993/1967] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:51.935084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:51.948063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a4ffbf-1983-42a7-9cb5-b17417390814 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:51.961723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:51.961723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:51.962533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:51.962834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] PATH_INFO: `/v3/projects/3bfd5124295b4fc2a79ef0a89a5af838/users/ea51bd0d578b41ec8851804fe75dde30/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:51.992645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3bfd5124295b4fc2a79ef0a89a5af838, user_id=ea51bd0d578b41ec8851804fe75dde30, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:51.995552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:52.011166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 975/1968] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:51 2022] PUT /identity/v3/projects/3bfd5124295b4fc2a79ef0a89a5af838/users/ea51bd0d578b41ec8851804fe75dde30/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:52.016053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:52.016983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:52.017266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:52.043736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:52.044950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:52.113787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 994/1969] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:52.123605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:52.125301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:52.185779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf823f63-c93c-4e71-83bf-bf78d7364f79 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:52.189381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e961d667-f01d-4db3-801e-df7565c94cff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:52.189987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961d667-f01d-4db3-801e-df7565c94cff service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:52.190265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961d667-f01d-4db3-801e-df7565c94cff service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:52.190536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961d667-f01d-4db3-801e-df7565c94cff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:52.199946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961d667-f01d-4db3-801e-df7565c94cff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:52.201363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e961d667-f01d-4db3-801e-df7565c94cff service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:52.210517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 976/1970] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:53.001157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:53.002605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:53.014494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ec6f4-7ef3-4c5b-8aca-f92610924736 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:53.019595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:53.020230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:53.020510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:53.020782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] PATH_INFO: `/v3/users/96729875839048eb951a08c3f3659787` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:53.022082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96729875839048eb951a08c3f3659787)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:53.024831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:53.082331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96729875839048eb951a08c3f3659787'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:53.083167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96729875839048eb951a08c3f3659787'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:53.105655 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96729875839048eb951a08c3f3659787'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:53.122990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96729875839048eb951a08c3f3659787'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:53.131227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96729875839048eb951a08c3f3659787'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:53.138950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 995/1971] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:52 2022] DELETE /identity/v3/users/96729875839048eb951a08c3f3659787 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:53.143773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:53.144176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:53.144710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:53.166877 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:53.168186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:53.202074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:53.241327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 977/1972] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:53.251900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:53.253326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:53.301234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:53.331597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55b4f5-c42d-43e1-9912-8f726b5e2e42 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:53.335409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:53.336097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:53.336451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:53.336884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:53.347012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:53.348289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:53.361058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 996/1973] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:53.956864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:53.958875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:53.973432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545fbc9-d2e1-438a-bffc-a909f7880d82 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:53.978475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:53.979356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:53.979633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:53.980052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] PATH_INFO: `/v3/projects/e76ac6ab5ec54d14a3bda2ee6861e1cf` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:53.981407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76ac6ab5ec54d14a3bda2ee6861e1cf)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:53.983572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:54.044428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76ac6ab5ec54d14a3bda2ee6861e1cf', 'request_id': 'req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.054975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76ac6ab5ec54d14a3bda2ee6861e1cf', 'request_id': 'req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.074135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76ac6ab5ec54d14a3bda2ee6861e1cf', 'request_id': 'req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.093354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] The token cache is being invalidate because project e76ac6ab5ec54d14a3bda2ee6861e1cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:54.093647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.094329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.096987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 978/1974] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:53 2022] DELETE /identity/v3/projects/e76ac6ab5ec54d14a3bda2ee6861e1cf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:54.101006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:54.118732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1f1b6-8165-4e7b-93a1-2e759a8f7cde service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:54.274399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:54.275120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:54.275418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:54.275701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] PATH_INFO: `/v3/users/e610e813fabc4c25be3d51ad15ad187a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:54.276920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e610e813fabc4c25be3d51ad15ad187a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:54.278991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:54.370463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e610e813fabc4c25be3d51ad15ad187a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.371208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e610e813fabc4c25be3d51ad15ad187a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.386397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e610e813fabc4c25be3d51ad15ad187a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.387427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:54.388854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:54.396045 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e610e813fabc4c25be3d51ad15ad187a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.405851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d432b4f4-4fda-442a-8170-53704c497cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e610e813fabc4c25be3d51ad15ad187a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.407910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd2cd7-51d4-4e51-8c99-ff654560c34f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:54.415092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 997/1975] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:54 2022] DELETE /identity/v3/users/e610e813fabc4c25be3d51ad15ad187a => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:54.433696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:54.434516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:54.434897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:54.435278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] PATH_INFO: `/v3/users/6de66c50b9b54fe99e7b3edeb6fb69d4` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:54.438207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de66c50b9b54fe99e7b3edeb6fb69d4)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:54.440532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:54.569859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de66c50b9b54fe99e7b3edeb6fb69d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.616920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de66c50b9b54fe99e7b3edeb6fb69d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.628505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de66c50b9b54fe99e7b3edeb6fb69d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.629203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de66c50b9b54fe99e7b3edeb6fb69d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.639691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de66c50b9b54fe99e7b3edeb6fb69d4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:54.647154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 979/1976] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:54 2022] DELETE /identity/v3/users/6de66c50b9b54fe99e7b3edeb6fb69d4 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:54.653023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:54.653457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:54.653832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:54.684244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:54.687466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:54.758486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:54.782033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 998/1977] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:54.811156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:54.816268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:54.959985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:55.037350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37603379-10bf-4379-baa8-a44958dabd02 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:55.043446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2ff95c-4e0e-480d-ad70-3ed5f596bc08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:55.044677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ff95c-4e0e-480d-ad70-3ed5f596bc08 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:55.045081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ff95c-4e0e-480d-ad70-3ed5f596bc08 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:55.045457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2ff95c-4e0e-480d-ad70-3ed5f596bc08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:55.057506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ff95c-4e0e-480d-ad70-3ed5f596bc08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:55.059842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2ff95c-4e0e-480d-ad70-3ed5f596bc08 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:55.073454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 980/1978] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:27:55.557855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:55.559422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:55.599591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb20854-7d6c-4011-a326-fd080816f8e4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:55.615771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:55.616696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:55.617157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:55.618243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] PATH_INFO: `/v3/projects/75f7a2171393492e993c2e15703c5816` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:55.623166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75f7a2171393492e993c2e15703c5816)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:55.626797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:55.759593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75f7a2171393492e993c2e15703c5816', 'request_id': 'req-ff6f9efb-f619-4758-bd68-fa227c132a35'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:55.779904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75f7a2171393492e993c2e15703c5816', 'request_id': 'req-ff6f9efb-f619-4758-bd68-fa227c132a35'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:55.804675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75f7a2171393492e993c2e15703c5816', 'request_id': 'req-ff6f9efb-f619-4758-bd68-fa227c132a35'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:55.831877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] The token cache is being invalidate because project 75f7a2171393492e993c2e15703c5816 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:55.832183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:55.832954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ff6f9efb-f619-4758-bd68-fa227c132a35 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:55.836179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 999/1979] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:55 2022] DELETE /identity/v3/projects/75f7a2171393492e993c2e15703c5816 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:55.842126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:55.843036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:55.843476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:55.869389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:55.870866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:55.951515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 981/1980] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:55.959427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:55.960082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:55.960394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:55.988507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:55.989850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:56.008869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.019542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1000/1981] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:56.020631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e54556a-ba42-4c05-ad6f-a2c72658114f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.028219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.029038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.029481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.029916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.030757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:56.031217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.033398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.059263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.066978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 982/1982] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:56.071583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1009171-4841-4097-ac24-35e5fe07b055 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.081880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.082485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.083860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.083860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.084476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.086409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.146163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1001/1983] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:56 2022] POST /identity/v3/projects => generated 379 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:56.151716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.185100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e3701-cf3f-488d-8d57-79d6b0460a77 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.247595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.249597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:56.345261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.347191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.347490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.347774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.350301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.356702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.426923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 983/1984] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:56 2022] POST /identity/v3/users => generated 290 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:56.431468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.438429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e959a074-2a7d-4ca2-abb0-fadf48e5d7d3 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.445701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.447323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.448136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.448136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] PATH_INFO: `/v3/projects/bd52d4519cf540ebbddc02d0d0171592` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.449510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd52d4519cf540ebbddc02d0d0171592)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.452208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.462277 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3407a2-3fdd-42a8-aba9-11e2b81a1daf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.483202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.484042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.484437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.484876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.485695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.487580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.511819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:56.514339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd52d4519cf540ebbddc02d0d0171592', 'request_id': 'req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.517999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 984/1985] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:56.519967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.529191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd52d4519cf540ebbddc02d0d0171592', 'request_id': 'req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.544090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd52d4519cf540ebbddc02d0d0171592', 'request_id': 'req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.544388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64d647-06fb-4127-b854-cc64e1d3f5e3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.571845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] The token cache is being invalidate because project bd52d4519cf540ebbddc02d0d0171592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:56.572599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.573297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.578644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1002/1986] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:56 2022] DELETE /identity/v3/projects/bd52d4519cf540ebbddc02d0d0171592 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:56.582726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.585402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:56.636117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:56.691193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.691981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.692268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.692707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.694064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.695748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.712211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 985/1987] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:56 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:56.713147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:56.715623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:56.739669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5c511-35f5-4b4c-bac0-e7f2ecde8fd0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.741072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca160f-5996-41a4-a030-499df60c6b86 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:56.745454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.746190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.746546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.746946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] PATH_INFO: `/v3/users/aed7be1ec10444b0a93be445b3c35446` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.748290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aed7be1ec10444b0a93be445b3c35446)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.750309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.753689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50ec97-a94b-4215-8ea5-644571f3e65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:56.754381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50ec97-a94b-4215-8ea5-644571f3e65c admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.754670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50ec97-a94b-4215-8ea5-644571f3e65c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.754980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50ec97-a94b-4215-8ea5-644571f3e65c admin admin] PATH_INFO: `/v3/projects/b03c3bb19cf643dfb4e9b1d3f0dbf256/users/f7e4663fbefd418f851c578c60b1776b/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.799791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50ec97-a94b-4215-8ea5-644571f3e65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b03c3bb19cf643dfb4e9b1d3f0dbf256, user_id=f7e4663fbefd418f851c578c60b1776b, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:56.806815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50ec97-a94b-4215-8ea5-644571f3e65c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:56.831906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 986/1988] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:56 2022] PUT /identity/v3/projects/b03c3bb19cf643dfb4e9b1d3f0dbf256/users/f7e4663fbefd418f851c578c60b1776b/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:56.844772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:56.845426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:56.845426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:56.849175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aed7be1ec10444b0a93be445b3c35446'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.850262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aed7be1ec10444b0a93be445b3c35446'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.868684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aed7be1ec10444b0a93be445b3c35446'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.881536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aed7be1ec10444b0a93be445b3c35446'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.890541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] MFA Rules not processed for user `f7e4663fbefd418f851c578c60b1776b`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:56.892735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:56.896648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aed7be1ec10444b0a93be445b3c35446'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:56.914189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1003/1989] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:27:56 2022] DELETE /identity/v3/users/aed7be1ec10444b0a93be445b3c35446 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:27:57.004153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 987/1990] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:57.009273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:57.012108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:57.135718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2ae9-35d4-4e50-a7a2-36641ab488e6 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:57.136951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:57.148545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:57.150732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.151199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.151686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.152978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:57.156475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:57.196432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1004/1991] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:57 2022] POST /identity/v3/projects => generated 377 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:57.197675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:57.301854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f6a6e2-eebe-482a-8eeb-00c8656de3c3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:57.362223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:57.366647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:57.394952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:57.437051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:57.437426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.437523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.437904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.438464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:57.443540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:57.497422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 988/1992] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:57 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:57.503032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:57.533823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1eee35-1ec3-4d6a-bd18-bf726b794512 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:57.559425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:57.560120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.560439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.560727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.561429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:57.563082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:57.596239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 989/1993] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:57.599003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:57.602307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712816d1-87a6-4bd0-a8b2-350ea0b3fcd3 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:57.621241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae4b9ba-0cf5-4631-a3ac-2d3d4f5434ab admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:57.641594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:57.642266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.642558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.642866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] PATH_INFO: `/v3/projects/eb10aabc831f401a9f719ad139a22bc4` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.645284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb10aabc831f401a9f719ad139a22bc4)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:57.645406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:57.645406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.645695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.646410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:57.646599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.647185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:57.649634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:57.680592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 990/1994] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:57.684926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:57.710369 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facbd78d-a15b-4d76-a59a-2c0bd2a3f9d0 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:57.721883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031a2f3e-e33b-42d5-a3a9-6739ca00bfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:57.722519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2f3e-e33b-42d5-a3a9-6739ca00bfc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.722942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2f3e-e33b-42d5-a3a9-6739ca00bfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.723298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031a2f3e-e33b-42d5-a3a9-6739ca00bfc6 admin admin] PATH_INFO: `/v3/projects/1d12303810fd4e6cbc19219b2e7daf86/users/d39276a793fe49899a3f3715b132c4d1/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.761549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a2f3e-e33b-42d5-a3a9-6739ca00bfc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d12303810fd4e6cbc19219b2e7daf86, user_id=d39276a793fe49899a3f3715b132c4d1, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:57.768878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031a2f3e-e33b-42d5-a3a9-6739ca00bfc6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:57.776958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb10aabc831f401a9f719ad139a22bc4', 'request_id': 'req-c327356f-b65d-4b5d-98fd-02ba41e5a570'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:57.797089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb10aabc831f401a9f719ad139a22bc4', 'request_id': 'req-c327356f-b65d-4b5d-98fd-02ba41e5a570'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:57.808827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 991/1995] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:57 2022] PUT /identity/v3/projects/1d12303810fd4e6cbc19219b2e7daf86/users/d39276a793fe49899a3f3715b132c4d1/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:57.812561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.812863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.813134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.817350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb10aabc831f401a9f719ad139a22bc4', 'request_id': 'req-c327356f-b65d-4b5d-98fd-02ba41e5a570'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:57.839809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] The token cache is being invalidate because project eb10aabc831f401a9f719ad139a22bc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:27:57.840097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:57.842587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c327356f-b65d-4b5d-98fd-02ba41e5a570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:27:57.847095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1005/1996] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:27:57 2022] DELETE /identity/v3/projects/eb10aabc831f401a9f719ad139a22bc4 => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:57.851697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964059-3410-41ff-ac14-ff088b99c104 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:57.851895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964059-3410-41ff-ac14-ff088b99c104 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:57.852731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1964059-3410-41ff-ac14-ff088b99c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:57.880834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] MFA Rules not processed for user `d39276a793fe49899a3f3715b132c4d1`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:57.882085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:57.922514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a1964059-3410-41ff-ac14-ff088b99c104 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:57.925856 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a1964059-3410-41ff-ac14-ff088b99c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:58.028929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 992/1997] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:58.030299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.031624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:58.074943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1006/1998] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:58.083504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.083804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.083995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.163872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:58.163872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:58.192524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1007/1999] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:58.195630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.203632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:58.219324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3a08b-4d66-4f78-9a62-6ede970296d2 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.230891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e5619-9524-4b2a-b8ba-4b0483c3c9df None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.237218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.241940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.242291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.242558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.243797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:27:58.244124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.245844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.256520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.257509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.258011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.258626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.259540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.261905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.271207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1008/2000] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:27:58.284498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.308131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f276163-ffa5-47bd-8f85-0611f0cfd436 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.324247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 993/2001] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:58 2022] POST /identity/v3/projects => generated 377 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:58.325923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.326399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.327050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.327331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.327608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.328241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.330271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.336019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:58.400719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1009/2002] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:58 2022] POST /identity/v3/projects => generated 365 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:58.406133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.447035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317b6e0-9802-47b6-bd4e-80cddd12925d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.517147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431da1d-3acf-4d2d-b975-b2eccb28d014 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.535334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.536644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.537336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.537988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.539029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.543986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.549149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.550114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.550401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.551845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.552503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.556970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.592451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 994/2003] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:58 2022] POST /identity/v3/users => generated 295 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:58.594325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.604580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1010/2004] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:58 2022] POST /identity/v3/users => generated 283 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:58.608847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.610008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e3f7e9-8501-452b-9423-c4bc1f69049e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.615943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.617263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.617263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.617616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.618499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.620479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.635457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641334ad-a476-4b55-9f95-23a89386b43b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.641552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.642247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.642464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 995/2005] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:58.645738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.645738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.645738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.645959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.647487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.659739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7a3be-f00b-4f73-ab2d-246f10af1213 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.670606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.671353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.671709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.672022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] PATH_INFO: `/v3/projects/704be82bd4a7437cb110b1b06ff9faaf/users/7ac8211db7404ad6bcdecee0471050d5/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.689414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1011/2006] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:27:58.691858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.712166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] RBAC: Authorizing `identity:create_grant(project_id=704be82bd4a7437cb110b1b06ff9faaf, user_id=7ac8211db7404ad6bcdecee0471050d5, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.714941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.724595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937579bf-cdb3-4c87-b5a4-bc62db01bb7e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.743289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.744500 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.745975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.746269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.747850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.750908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.752975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 996/2007] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:58 2022] PUT /identity/v3/projects/704be82bd4a7437cb110b1b06ff9faaf/users/7ac8211db7404ad6bcdecee0471050d5/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:58.756851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.784381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1012/2008] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:58.792860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:58.818955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b4d864-e788-44c4-96ad-4a8b3e165d8c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.940601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2c11d6-2615-4109-a97f-aa654c5a6805 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:58.956070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.957692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.958875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.959054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:58.960602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:58.966205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:58.973272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a3e3bd-2f46-43b9-b4c0-4134ab8218b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:58.987210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3e3bd-2f46-43b9-b4c0-4134ab8218b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:58.990886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3e3bd-2f46-43b9-b4c0-4134ab8218b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:58.991295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a3e3bd-2f46-43b9-b4c0-4134ab8218b3 admin admin] PATH_INFO: `/v3/projects/8deaf108e4fb4900bc07b407e0baa3b6/users/cfee2d474a4a4453987f08efd3881dc7/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.010588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 997/2009] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:59.015334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.022037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3e3bd-2f46-43b9-b4c0-4134ab8218b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8deaf108e4fb4900bc07b407e0baa3b6, user_id=cfee2d474a4a4453987f08efd3881dc7, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.026977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a3e3bd-2f46-43b9-b4c0-4134ab8218b3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.027343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:59.038034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518ca76c-fbe1-4b8d-8629-67eac2f70cf2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.053243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60356d5-c4ff-44b8-829d-08a75c5938b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.054660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60356d5-c4ff-44b8-829d-08a75c5938b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.056056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60356d5-c4ff-44b8-829d-08a75c5938b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.056552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60356d5-c4ff-44b8-829d-08a75c5938b8 admin admin] PATH_INFO: `/v3/projects/704be82bd4a7437cb110b1b06ff9faaf/users/7ac8211db7404ad6bcdecee0471050d5/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.058564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1013/2010] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:58 2022] PUT /identity/v3/projects/8deaf108e4fb4900bc07b407e0baa3b6/users/cfee2d474a4a4453987f08efd3881dc7/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:59.061270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60356d5-c4ff-44b8-829d-08a75c5938b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=704be82bd4a7437cb110b1b06ff9faaf, user_id=7ac8211db7404ad6bcdecee0471050d5, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.065367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60356d5-c4ff-44b8-829d-08a75c5938b8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.069400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.070218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.070218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.096819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 998/2011] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:59 2022] PUT /identity/v3/projects/704be82bd4a7437cb110b1b06ff9faaf/users/7ac8211db7404ad6bcdecee0471050d5/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:59.107573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.107924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.108141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.113639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] MFA Rules not processed for user `cfee2d474a4a4453987f08efd3881dc7`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:59.114974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:59.125611 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:59.181668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] MFA Rules not processed for user `7ac8211db7404ad6bcdecee0471050d5`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:27:59.183086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:59.226346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1014/2012] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:27:59.229423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.329585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 999/2013] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:27:59 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:27:59.345135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.347064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:59.418411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77e6b6a-5718-47ed-a88a-38958ba04a8a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.423567 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.424489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.424779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.425056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.425884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.427984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.450597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fa377d-ed94-4a16-aaec-3438232b0039 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.464134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.464774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.465065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.465360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.478154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1015/2014] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:27:59 2022] POST /identity/v3/projects => generated 369 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:59.479103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.480462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.482000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.506515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1000/2015] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:59.549051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.562335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aafe61-4ba0-49a6-9ac0-9deae41ac6da service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.599586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a8545-75e0-4b13-8c99-6760e11e0d51 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.606001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.607484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.607973 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.608441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.609336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.611585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.662759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1016/2016] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:27:59 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:27:59.668750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.682936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e154fa-89ea-4b89-a8a2-b8f331dd30c5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.689763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.690532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.690881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.691336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.693419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.693887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.722571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.724076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.724076 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.724250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.734251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:27:59.734558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1017/2017] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:27:59.735894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.749693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0adfe2-b9a1-4d20-9cfa-412a6c85ec55 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.758336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.759243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.759577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.759809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] PATH_INFO: `/v3/projects/9ed92e1a64cd4d8fb07d40796e274ff4/users/00d356da38eb46e69e99086820164669/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.774622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:59.781838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed92e1a64cd4d8fb07d40796e274ff4, user_id=00d356da38eb46e69e99086820164669, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.786472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.810842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:27:59.817511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1018/2018] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:27:59 2022] PUT /identity/v3/projects/9ed92e1a64cd4d8fb07d40796e274ff4/users/00d356da38eb46e69e99086820164669/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:27:59.822561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:27:59.880162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.882213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:27:59.896403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1001/2019] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:27:59 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:27:59.985616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24450fab-b4d7-4061-b46d-341f7e067180 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:27:59.991913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6775043e-473a-45da-a9f9-4572ee8195dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:27:59.993925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775043e-473a-45da-a9f9-4572ee8195dc admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:27:59.994620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775043e-473a-45da-a9f9-4572ee8195dc admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:27:59.995056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6775043e-473a-45da-a9f9-4572ee8195dc admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:27:59.995796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775043e-473a-45da-a9f9-4572ee8195dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:27:59.997855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6775043e-473a-45da-a9f9-4572ee8195dc admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:00.035478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1019/2020] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:27:59 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:00.038459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:00.064799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2027ce-430b-4383-912c-8b418aa49acb service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:00.079510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d4f271-3eae-47b3-ba30-484f07c808df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:00.080263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f271-3eae-47b3-ba30-484f07c808df admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.080592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f271-3eae-47b3-ba30-484f07c808df admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.080914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d4f271-3eae-47b3-ba30-484f07c808df admin admin] PATH_INFO: `/v3/projects/9ed92e1a64cd4d8fb07d40796e274ff4/users/00d356da38eb46e69e99086820164669/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.084156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4f271-3eae-47b3-ba30-484f07c808df admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed92e1a64cd4d8fb07d40796e274ff4, user_id=00d356da38eb46e69e99086820164669, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:00.097528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d4f271-3eae-47b3-ba30-484f07c808df admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:00.113721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1002/2021] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:00 2022] PUT /identity/v3/projects/9ed92e1a64cd4d8fb07d40796e274ff4/users/00d356da38eb46e69e99086820164669/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:00.125518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.126166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.126440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.204782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] MFA Rules not processed for user `00d356da38eb46e69e99086820164669`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:00.207718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:00.374936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b817a-f164-4708-9fe0-28bf8fa78f6a None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.375273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b817a-f164-4708-9fe0-28bf8fa78f6a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.375744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b817a-f164-4708-9fe0-28bf8fa78f6a None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.377648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1003/2022] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:28:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 17 23:28:00.396550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.396946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.397230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.408040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1020/2023] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:00.414392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:00.450254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:00.453875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:00.564687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894e9c4-2e9a-4a95-82e7-b1b6e3e5386f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:00.575391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:00.576552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.576552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.576776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.601128 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:00.603039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:00.626391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1021/2024] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:00.628651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:00.630534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:00.659209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1004/2025] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:28:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:00.669628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:00.671984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:00.674009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:00.700592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b841f4fd-ccbb-4e65-a3ce-530bef9a3049 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:00.711349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:00.713144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.713583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.714011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.725569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:00.733860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:00.753089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1005/2026] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:00.754800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:00.756298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:00.771964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81cbfc7-83ff-41b7-b0cf-b745171d8140 service placement] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:00.781409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0be981c-4b6a-477d-a8e7-f39e763a0cba service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:00.783850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccdea29d-2974-4f67-8ad2-cc23546664a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:00.785209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdea29d-2974-4f67-8ad2-cc23546664a6 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.785634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdea29d-2974-4f67-8ad2-cc23546664a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.785868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccdea29d-2974-4f67-8ad2-cc23546664a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.787729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:00.788669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.789158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.790343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] PATH_INFO: `/v3/users/c7ce99c5bac948a7bccd3fdf5cb2e462` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.792955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7ce99c5bac948a7bccd3fdf5cb2e462)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:00.794797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:00.849710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7ce99c5bac948a7bccd3fdf5cb2e462'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:00.850479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7ce99c5bac948a7bccd3fdf5cb2e462'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:00.864166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7ce99c5bac948a7bccd3fdf5cb2e462'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:00.864882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdea29d-2974-4f67-8ad2-cc23546664a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:00.866594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccdea29d-2974-4f67-8ad2-cc23546664a6 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:00.875496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7ce99c5bac948a7bccd3fdf5cb2e462'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:00.879371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1006/2027] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:00.880757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:00.881110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:00.881391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:00.887162 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7ce99c5bac948a7bccd3fdf5cb2e462'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:00.899491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1022/2028] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:00 2022] DELETE /identity/v3/users/c7ce99c5bac948a7bccd3fdf5cb2e462 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:00.912891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] MFA Rules not processed for user `ea51bd0d578b41ec8851804fe75dde30`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:00.914115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:00.966483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:01.023831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1007/2029] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:01.029591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.031938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:01.150237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf7a26-4a6d-4c7c-8fd3-4240ded614f3 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.155656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.156557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.156928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.157354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.158312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.160939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.203806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.205373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:01.213078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1023/2030] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:01 2022] POST /identity/v3/projects => generated 371 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:28:01.214735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.233628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399ed1e0-beb1-4e9e-bedb-00aa7f5428c6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.246263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:01.377265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6f7cb7-3e4a-4838-bb96-931c32b0ab05 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.386733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.388174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.388675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.389033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.389944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.392323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.453364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1024/2031] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:01 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:01.457773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.471722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.473486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.474113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.474581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] PATH_INFO: `/v3/projects/2a9b03c12fb84d65acd5cce493048c9c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.476063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=2a9b03c12fb84d65acd5cce493048c9c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.476175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3b711-1336-4ca9-a07c-f1d4b635f02e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.480004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.482310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.483148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.483509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.483951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.484864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.486740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.510667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1025/2032] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:01.513722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.533236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0cb0c5-bede-4ee6-9f22-7893ffef14e4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.553023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.553719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.554005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.554387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] PATH_INFO: `/v3/projects/957c06d7ec254c649802c5def7cc3ccb/users/c470cb11a9cd46a0b1e4938ccb1995f1/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.591068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=957c06d7ec254c649802c5def7cc3ccb, user_id=c470cb11a9cd46a0b1e4938ccb1995f1, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.594112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.594372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2a9b03c12fb84d65acd5cce493048c9c', 'request_id': 'req-5aa998f7-af25-42d9-959e-380cec41bcfc'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:01.601684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2a9b03c12fb84d65acd5cce493048c9c', 'request_id': 'req-5aa998f7-af25-42d9-959e-380cec41bcfc'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:01.620947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2a9b03c12fb84d65acd5cce493048c9c', 'request_id': 'req-5aa998f7-af25-42d9-959e-380cec41bcfc'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:01.627744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1026/2033] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:01 2022] PUT /identity/v3/projects/957c06d7ec254c649802c5def7cc3ccb/users/c470cb11a9cd46a0b1e4938ccb1995f1/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:01.628760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.655370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] The token cache is being invalidate because project 2a9b03c12fb84d65acd5cce493048c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:01.659035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:01.659986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5aa998f7-af25-42d9-959e-380cec41bcfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:01.662494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1008/2034] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:01 2022] DELETE /identity/v3/projects/2a9b03c12fb84d65acd5cce493048c9c => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:01.675917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.676215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.676509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.720665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:01.722073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:01.747149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc456dfe-1bec-40c2-8d22-86c4f2e4b2d0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.754821 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.755774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.756247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.756694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.757564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.761010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.782563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1027/2035] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:01.785950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:01.787799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:01.803130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae5c71-29dc-4ef3-9045-37a967c887e7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:01.809636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32f870-4493-4220-8058-6993714a11ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:01.810373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32f870-4493-4220-8058-6993714a11ae admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.810735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32f870-4493-4220-8058-6993714a11ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.811043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32f870-4493-4220-8058-6993714a11ae admin admin] PATH_INFO: `/v3/projects/957c06d7ec254c649802c5def7cc3ccb/users/c470cb11a9cd46a0b1e4938ccb1995f1/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.813291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32f870-4493-4220-8058-6993714a11ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=957c06d7ec254c649802c5def7cc3ccb, user_id=c470cb11a9cd46a0b1e4938ccb1995f1, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:01.816059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32f870-4493-4220-8058-6993714a11ae admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:01.821619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:01.838133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1028/2036] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:01 2022] PUT /identity/v3/projects/957c06d7ec254c649802c5def7cc3ccb/users/c470cb11a9cd46a0b1e4938ccb1995f1/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:01.852618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1009/2037] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:01.854311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:01.854604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:01.854923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:01.889010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:01.890310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:01.959894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:01.983156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1029/2038] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:01.987612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.013911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b365187-224b-4c22-98f3-ab6f69e944c0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.019021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.019726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.020078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.020433 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.021177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:02.021821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.023489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.045007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.046515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1010/2039] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:02.065173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4103afe0-bd71-4d8c-a9c1-8388629240ba None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.073926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.074758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.074932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.075208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.075892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.078037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.115579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1030/2040] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:02 2022] POST /identity/v3/projects => generated 405 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:02.131847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.148507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebb6a4-7e46-4190-8107-a25fc21122bf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.253477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.254494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.254799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.255133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.255855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.258940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.296685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1011/2041] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:02 2022] POST /identity/v3/users => generated 303 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:02.301351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.332319 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a372e38-df08-4ac9-9435-528c1ea021bc admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.343245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.346062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.346530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.347031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.347873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.352092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.373376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1031/2042] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:02.377543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.393183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91c32ae-a3e0-4e28-bac2-144574dd32f1 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.400561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9167991-7f75-43be-ab62-4a29593d81b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.401211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9167991-7f75-43be-ab62-4a29593d81b6 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.401496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9167991-7f75-43be-ab62-4a29593d81b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.402466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9167991-7f75-43be-ab62-4a29593d81b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.402936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9167991-7f75-43be-ab62-4a29593d81b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.405976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9167991-7f75-43be-ab62-4a29593d81b6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.425985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1012/2043] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:28:02.430526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.443172 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc644358-0edc-49a4-992d-0bc3adb4a45d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.449846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.450653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.450972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.451301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] PATH_INFO: `/v3/projects/3a7d4b9240dc44e0aab4194da5bff00f/users/a5fc9f7c1e3844489b48afe1186800df/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.475695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7d4b9240dc44e0aab4194da5bff00f, user_id=a5fc9f7c1e3844489b48afe1186800df, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.482204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.506747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1032/2044] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:02 2022] PUT /identity/v3/projects/3a7d4b9240dc44e0aab4194da5bff00f/users/a5fc9f7c1e3844489b48afe1186800df/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:02.517059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.517353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.517631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.565580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] MFA Rules not processed for user `a5fc9f7c1e3844489b48afe1186800df`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:02.567349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:02.710159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1013/2045] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:02.719156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.877529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f57a62-603c-47ae-9296-cde8160fcb56 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:02.892589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:02.893225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:02.893599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:02.893769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:02.894417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:02.896395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:02.954451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1033/2046] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:02 2022] POST /identity/v3/projects => generated 403 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:02.959623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:02.981448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c947aa9f-d6fb-437c-888d-62f93e4ffddb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.089869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:03.109820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.110465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.110771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.111058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.111703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:03.113640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:03.177667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1014/2047] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:02 2022] POST /identity/v3/users => generated 308 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:03.182796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:03.197927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d09784-4e70-409a-8523-ce3b0816a977 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.213978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.214795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.215165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.215640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.218889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:03.221249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:03.258558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1034/2048] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:03.260826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:03.275457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd330b9-f250-45cf-85c3-6a5d8402d283 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.300172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.301778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.302231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.303411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] PATH_INFO: `/v3/projects/4a889ef5f1604f3b918e0c43510642a1/users/02a12d7a012b42069866094f3656db8a/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.337520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a889ef5f1604f3b918e0c43510642a1, user_id=02a12d7a012b42069866094f3656db8a, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:03.341105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:03.363342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1015/2049] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:03 2022] PUT /identity/v3/projects/4a889ef5f1604f3b918e0c43510642a1/users/02a12d7a012b42069866094f3656db8a/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:03.367033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:03.383040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ababe-8d2d-44d6-ab0c-6eba8999a5d1 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.476279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:03.478139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:03.488447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.490271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.490763 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.491074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.491809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:03.496213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:03.514369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1035/2050] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:03 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:28:03.519728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:03.549989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1704edb5-60f7-42fb-b235-bb5e2db2299c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.561849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d963b052-411a-4bd1-88d9-6aa5c77e498c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.563196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b052-411a-4bd1-88d9-6aa5c77e498c admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.565108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b052-411a-4bd1-88d9-6aa5c77e498c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.565403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d963b052-411a-4bd1-88d9-6aa5c77e498c admin admin] PATH_INFO: `/v3/projects/4a889ef5f1604f3b918e0c43510642a1/users/02a12d7a012b42069866094f3656db8a/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.569505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b052-411a-4bd1-88d9-6aa5c77e498c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a889ef5f1604f3b918e0c43510642a1, user_id=02a12d7a012b42069866094f3656db8a, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:03.572601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d963b052-411a-4bd1-88d9-6aa5c77e498c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:03.579322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:03.602678 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1036/2051] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:03 2022] PUT /identity/v3/projects/4a889ef5f1604f3b918e0c43510642a1/users/02a12d7a012b42069866094f3656db8a/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:03.604266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.604555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.604836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.608538 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02fe60-b61c-43f0-b39f-a1374948f045 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.641553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] MFA Rules not processed for user `02a12d7a012b42069866094f3656db8a`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:03.643112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:03.704739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.705402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.705693 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.705974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] PATH_INFO: `/v3/users/f7e4663fbefd418f851c578c60b1776b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.709372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7e4663fbefd418f851c578c60b1776b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:03.713653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:03.753952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1037/2052] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:03 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:03.770593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:03.772705 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:03.809713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7e4663fbefd418f851c578c60b1776b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:03.828201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7e4663fbefd418f851c578c60b1776b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:03.832905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:03.838716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7e4663fbefd418f851c578c60b1776b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:03.839785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7e4663fbefd418f851c578c60b1776b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:03.857250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d8bc71ad-dc4a-4448-ba99-cc6f9489a06d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7e4663fbefd418f851c578c60b1776b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:03.864883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc99a2-8d1e-43f8-a722-dadc4a8e033f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:03.865186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1016/2053] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:03 2022] DELETE /identity/v3/users/f7e4663fbefd418f851c578c60b1776b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:03.870184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.871786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.872491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.905282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:03.906735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:03.940769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:03.941684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:03.942100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:03.942516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:03.944551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:04.005659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1017/2054] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:04.016400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:04.023709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:04.023709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:04.063847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:04.066584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:04.099479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1038/2055] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:03 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:04.159016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edabb67-b41a-4a99-8b91-9541469f92dc None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:04.169818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bf338a-7a8c-47d5-9e50-f648dca54be3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:04.170593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf338a-7a8c-47d5-9e50-f648dca54be3 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:04.170862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf338a-7a8c-47d5-9e50-f648dca54be3 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:04.171242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bf338a-7a8c-47d5-9e50-f648dca54be3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:04.212359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf338a-7a8c-47d5-9e50-f648dca54be3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:04.216659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bf338a-7a8c-47d5-9e50-f648dca54be3 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:04.234897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1018/2056] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:04.317085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:04.319139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:04.426636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde1cc8-3d82-4491-9101-d3877af8d8ec service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:04.439007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:04.439953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:04.440381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:04.441051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] PATH_INFO: `/v3/users/a5fc9f7c1e3844489b48afe1186800df` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:04.455637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fc9f7c1e3844489b48afe1186800df)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:04.462227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:04.568245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fc9f7c1e3844489b48afe1186800df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:04.569140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fc9f7c1e3844489b48afe1186800df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:04.606289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fc9f7c1e3844489b48afe1186800df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:04.623230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fc9f7c1e3844489b48afe1186800df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:04.643064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fc9f7c1e3844489b48afe1186800df'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:04.674573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1039/2057] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:04 2022] DELETE /identity/v3/users/a5fc9f7c1e3844489b48afe1186800df => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:04.677396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:04.678199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:04.678447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:04.737153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:04.745418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:04.912764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1019/2058] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:04.931063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:04.933783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:04.975458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:04.977716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:04.998690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20f0b1-392b-4499-b0cb-6619b9638f7e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:05.012394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:05.013363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:05.013798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:05.014869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] PATH_INFO: `/v3/projects/b03c3bb19cf643dfb4e9b1d3f0dbf256` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:05.018464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b03c3bb19cf643dfb4e9b1d3f0dbf256)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:05.027262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:05.065845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555fca89-f981-46bb-902e-cb68d1d49ca4 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:05.079943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:05.080209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:05.080660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:05.081007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:05.112025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:05.123845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:05.125374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:05.136815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b03c3bb19cf643dfb4e9b1d3f0dbf256', 'request_id': 'req-60563ac9-180e-4764-8737-59cfb05a7ddf'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.145202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b03c3bb19cf643dfb4e9b1d3f0dbf256', 'request_id': 'req-60563ac9-180e-4764-8737-59cfb05a7ddf'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.147799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1040/2059] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:05.173462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b03c3bb19cf643dfb4e9b1d3f0dbf256', 'request_id': 'req-60563ac9-180e-4764-8737-59cfb05a7ddf'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.209469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] The token cache is being invalidate because project b03c3bb19cf643dfb4e9b1d3f0dbf256 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:05.212359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.215107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.219924 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1020/2060] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:04 2022] DELETE /identity/v3/projects/b03c3bb19cf643dfb4e9b1d3f0dbf256 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:05.224533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:05.238980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35cd86f-782a-45a3-be2c-98c5469f3da4 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:05.381964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:05.382629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:05.382935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:05.383776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] PATH_INFO: `/v3/users/d39276a793fe49899a3f3715b132c4d1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:05.389397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=d39276a793fe49899a3f3715b132c4d1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:05.391581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:05.398437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:05.515494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:05.517914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:05.568722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60563ac9-180e-4764-8737-59cfb05a7ddf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:05.573935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd39276a793fe49899a3f3715b132c4d1'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.574641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd39276a793fe49899a3f3715b132c4d1'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.590441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:05.591465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:05.591987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:05.592472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] PATH_INFO: `/v3/users/cfee2d474a4a4453987f08efd3881dc7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:05.594862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfee2d474a4a4453987f08efd3881dc7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:05.597072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:05.603301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd39276a793fe49899a3f3715b132c4d1'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.624884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd39276a793fe49899a3f3715b132c4d1'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.643404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-84b6c358-4ed0-417a-b783-82bc8680ea4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd39276a793fe49899a3f3715b132c4d1'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.656291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1041/2061] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:05 2022] DELETE /identity/v3/users/d39276a793fe49899a3f3715b132c4d1 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:05.723992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfee2d474a4a4453987f08efd3881dc7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.757873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfee2d474a4a4453987f08efd3881dc7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.777251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfee2d474a4a4453987f08efd3881dc7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.779037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfee2d474a4a4453987f08efd3881dc7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.799054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfee2d474a4a4453987f08efd3881dc7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:05.808761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1021/2062] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:05 2022] DELETE /identity/v3/users/cfee2d474a4a4453987f08efd3881dc7 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:05.812994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:05.813249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:05.813535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:05.849513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:05.850792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:05.982129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:05.983707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:06.029250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1042/2063] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:06.052127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:06.056249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:06.169515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67af6f0-6c2c-40b7-9bc1-cc8fdc2bed04 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:06.177302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a2f952-0b16-434b-b924-2ab15d1c1c6b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:06.182388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:06.183050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:06.183338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:06.183619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:06.183990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:06.184649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:06.184938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:06.185216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] PATH_INFO: `/v3/projects/3a7d4b9240dc44e0aab4194da5bff00f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:06.189460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7d4b9240dc44e0aab4194da5bff00f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:06.191531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:06.195428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:06.198421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:06.212587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1043/2064] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:06.260469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:06.311512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7d4b9240dc44e0aab4194da5bff00f', 'request_id': 'req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.325367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7d4b9240dc44e0aab4194da5bff00f', 'request_id': 'req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.344669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7d4b9240dc44e0aab4194da5bff00f', 'request_id': 'req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.375324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] The token cache is being invalidate because project 3a7d4b9240dc44e0aab4194da5bff00f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:06.386741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.386741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.386741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1022/2065] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:05 2022] DELETE /identity/v3/projects/3a7d4b9240dc44e0aab4194da5bff00f => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:06.387175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:06.398911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed5f5b2-f73e-43de-815f-215a40387545 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:06.433529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:06.461772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:06.463638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:06.522039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:06.524983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:06.525282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:06.525555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] PATH_INFO: `/v3/users/02a12d7a012b42069866094f3656db8a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:06.531350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02a12d7a012b42069866094f3656db8a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:06.536704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:06.572483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3b8d5b-d0b5-430d-ae67-5d3dea4bbca9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:06.581785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:06.583160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:06.583630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:06.584197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] PATH_INFO: `/v3/projects/1d12303810fd4e6cbc19219b2e7daf86` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:06.585644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d12303810fd4e6cbc19219b2e7daf86)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:06.588514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:06.648281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02a12d7a012b42069866094f3656db8a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.650368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02a12d7a012b42069866094f3656db8a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.683133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02a12d7a012b42069866094f3656db8a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.693239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d12303810fd4e6cbc19219b2e7daf86', 'request_id': 'req-719109ca-5adb-4ff3-9446-719ce3a28d3f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.698495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02a12d7a012b42069866094f3656db8a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.711229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d12303810fd4e6cbc19219b2e7daf86', 'request_id': 'req-719109ca-5adb-4ff3-9446-719ce3a28d3f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.711952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02a12d7a012b42069866094f3656db8a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.730249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1044/2066] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:06 2022] DELETE /identity/v3/users/02a12d7a012b42069866094f3656db8a => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:06.734584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d12303810fd4e6cbc19219b2e7daf86', 'request_id': 'req-719109ca-5adb-4ff3-9446-719ce3a28d3f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.761378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] The token cache is being invalidate because project 1d12303810fd4e6cbc19219b2e7daf86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:06.761836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.763602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:06.770172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1023/2067] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:06 2022] DELETE /identity/v3/projects/1d12303810fd4e6cbc19219b2e7daf86 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:06.771700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:06.774675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:06.899991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:06.903058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:06.923857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e58748-f5aa-4944-9e69-cc4c0749f227 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:06.935720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:06.936390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:06.936681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:06.937006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] PATH_INFO: `/v3/users/7ac8211db7404ad6bcdecee0471050d5` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:06.942182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ac8211db7404ad6bcdecee0471050d5)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:06.950913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:07.087424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:07.092828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:07.098824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ac8211db7404ad6bcdecee0471050d5'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.101084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ac8211db7404ad6bcdecee0471050d5'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.146586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719109ca-5adb-4ff3-9446-719ce3a28d3f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:07.148569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ac8211db7404ad6bcdecee0471050d5'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.159751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:07.160647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:07.160928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:07.162597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] PATH_INFO: `/v3/projects/8deaf108e4fb4900bc07b407e0baa3b6` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:07.167270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ac8211db7404ad6bcdecee0471050d5'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.170605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=8deaf108e4fb4900bc07b407e0baa3b6)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:07.178792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:07.186918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ac8211db7404ad6bcdecee0471050d5'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.202764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1045/2068] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:06 2022] DELETE /identity/v3/users/7ac8211db7404ad6bcdecee0471050d5 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:07.300656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8deaf108e4fb4900bc07b407e0baa3b6', 'request_id': 'req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.312210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8deaf108e4fb4900bc07b407e0baa3b6', 'request_id': 'req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.324580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8deaf108e4fb4900bc07b407e0baa3b6', 'request_id': 'req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.359626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] The token cache is being invalidate because project 8deaf108e4fb4900bc07b407e0baa3b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:07.360045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.360750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.362588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1024/2069] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:06 2022] DELETE /identity/v3/projects/8deaf108e4fb4900bc07b407e0baa3b6 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:07.366516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:07.370461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:07.380231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:07.385948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:07.536336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2ca1f-c220-4743-8aed-989ba7ad7238 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:07.548951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:07.549667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:07.549957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:07.550240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] PATH_INFO: `/v3/users/00d356da38eb46e69e99086820164669` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:07.553460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d356da38eb46e69e99086820164669)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:07.558696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:07.563584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8f956c-3c2c-4279-b545-6fee2e5bdbbe admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:07.584069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:07.584904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:07.585190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:07.585886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] PATH_INFO: `/v3/projects/4a889ef5f1604f3b918e0c43510642a1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:07.589287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a889ef5f1604f3b918e0c43510642a1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:07.598105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:07.683490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d356da38eb46e69e99086820164669'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.685434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d356da38eb46e69e99086820164669'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.723114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d356da38eb46e69e99086820164669'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.744596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d356da38eb46e69e99086820164669'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.747758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a889ef5f1604f3b918e0c43510642a1', 'request_id': 'req-1fed0763-83be-4f8f-be6a-d9b015d3f111'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.771807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-61c2ad9a-2fe8-44f6-8281-eb60a5b3cefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d356da38eb46e69e99086820164669'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.775013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a889ef5f1604f3b918e0c43510642a1', 'request_id': 'req-1fed0763-83be-4f8f-be6a-d9b015d3f111'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.785296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1046/2070] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:07 2022] DELETE /identity/v3/users/00d356da38eb46e69e99086820164669 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:07.800544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a889ef5f1604f3b918e0c43510642a1', 'request_id': 'req-1fed0763-83be-4f8f-be6a-d9b015d3f111'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.825944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] The token cache is being invalidate because project 4a889ef5f1604f3b918e0c43510642a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:07.826297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.828491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:07.838808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1025/2071] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:07 2022] DELETE /identity/v3/projects/4a889ef5f1604f3b918e0c43510642a1 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:07.839300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1018-ba0d-4f55-aba0-6f338e508c3c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:07.839590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1018-ba0d-4f55-aba0-6f338e508c3c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:07.839868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e1018-ba0d-4f55-aba0-6f338e508c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:07.875784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-211e1018-ba0d-4f55-aba0-6f338e508c3c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:07.877903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-211e1018-ba0d-4f55-aba0-6f338e508c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:07.987688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:07.991203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.016380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:08.041906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:08.116448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1047/2072] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:08.120113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.120420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.120701 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.180953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:08.182577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.184324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fed0763-83be-4f8f-be6a-d9b015d3f111 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.209484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.209484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.209484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.209484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] PATH_INFO: `/v3/projects/704be82bd4a7437cb110b1b06ff9faaf` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.211100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1048/2073] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:08.212777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.214619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=704be82bd4a7437cb110b1b06ff9faaf)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.219455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.227493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0decdc-f255-43c7-9723-f270ed48c407 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.234419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.235929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.236229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.237044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.237787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:08.238592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.240021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.257530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1049/2074] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:08.263649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.285791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a65911-1328-4a0b-aefc-d87a3e1a02c7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.293193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.294121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.295358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.297300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.300114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.333866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.342161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '704be82bd4a7437cb110b1b06ff9faaf', 'request_id': 'req-5be6abf3-e921-42e2-950b-f64020f59085'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:08.360154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '704be82bd4a7437cb110b1b06ff9faaf', 'request_id': 'req-5be6abf3-e921-42e2-950b-f64020f59085'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:08.387148 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '704be82bd4a7437cb110b1b06ff9faaf', 'request_id': 'req-5be6abf3-e921-42e2-950b-f64020f59085'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:08.410863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] The token cache is being invalidate because project 704be82bd4a7437cb110b1b06ff9faaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:08.411173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:08.416056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5be6abf3-e921-42e2-950b-f64020f59085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:08.422302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1026/2075] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:07 2022] DELETE /identity/v3/projects/704be82bd4a7437cb110b1b06ff9faaf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:08.424152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f541ac-2b06-4b77-8ba8-b34f4acb775d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.424450 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f541ac-2b06-4b77-8ba8-b34f4acb775d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.424730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f541ac-2b06-4b77-8ba8-b34f4acb775d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.437304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1050/2076] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/projects => generated 375 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:08.439010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.442970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.472937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d7f541ac-2b06-4b77-8ba8-b34f4acb775d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:08.474749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d7f541ac-2b06-4b77-8ba8-b34f4acb775d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.545308 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdf5d3b-8545-4e73-8215-4aac5b1245ec admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.576872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.576872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.577234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.577323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.578123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.582437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.617071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1027/2077] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:08.634019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.634560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.635116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.637892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1051/2078] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:08.642364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.671091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231bfd9-ab51-401e-a874-3cb20c02daac admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.672726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:08.674211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.684618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.685324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.685547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.686001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.686658 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.690431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.701491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1028/2079] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:08.702933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.710538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1052/2080] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:08.715507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.720593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09bb7e9-b59e-4dc5-aa2a-a18a2c225811 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.734251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8f7cdf-f252-42b5-95dc-6e9205605aa8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.735579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.736241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.736527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.736802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.737630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:08.737929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.739611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.753483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.754127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.754397 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.754675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.755402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.756979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.766147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1029/2081] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:08.767142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.781232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1053/2082] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:08.783940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.787004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0747e0-c7fa-40a0-ab9c-d10ccaa3fb8e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.810245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff851f14-e962-4785-abd4-a3bfe70fa7f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.811023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff851f14-e962-4785-abd4-a3bfe70fa7f6 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.811436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff851f14-e962-4785-abd4-a3bfe70fa7f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.812388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff851f14-e962-4785-abd4-a3bfe70fa7f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.813380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff851f14-e962-4785-abd4-a3bfe70fa7f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.817076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d592eea5-edde-44d7-a9f9-dda471505dca admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:08.821279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff851f14-e962-4785-abd4-a3bfe70fa7f6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.828967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:08.829826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.830217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.830600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] PATH_INFO: `/v3/projects/d98ef1ec06e64888bbaa689dcb2fd427/users/060b4c24a34a4e3aa6a9775581c3a7f7/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.856669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d98ef1ec06e64888bbaa689dcb2fd427, user_id=060b4c24a34a4e3aa6a9775581c3a7f7, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:08.860664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:08.869436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:08.885831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1054/2083] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:08 2022] PUT /identity/v3/projects/d98ef1ec06e64888bbaa689dcb2fd427/users/060b4c24a34a4e3aa6a9775581c3a7f7/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:08.886953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:08.891231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.901419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1030/2084] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:08.907725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:08.908387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:08.908685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:08.979073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] MFA Rules not processed for user `060b4c24a34a4e3aa6a9775581c3a7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:08.980333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:08.991807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:09.017963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e4960d-5864-424c-ae55-5d7aa513b337 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.123959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1031/2085] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:09.124484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.125632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.125747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.126152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.126568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] PATH_INFO: `/v3/projects/9ed92e1a64cd4d8fb07d40796e274ff4` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.128184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed92e1a64cd4d8fb07d40796e274ff4)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.130627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.144236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1af477-0f3a-43c0-8abb-f584c7ebca98 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.171719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.172937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.173769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.173769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.175909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.182285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.207363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed92e1a64cd4d8fb07d40796e274ff4', 'request_id': 'req-87c26b0c-80a0-46ab-ab11-1cd293f180af'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:09.217424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed92e1a64cd4d8fb07d40796e274ff4', 'request_id': 'req-87c26b0c-80a0-46ab-ab11-1cd293f180af'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:09.230951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed92e1a64cd4d8fb07d40796e274ff4', 'request_id': 'req-87c26b0c-80a0-46ab-ab11-1cd293f180af'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:09.232093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1032/2086] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:09.233154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.249417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad4d1cd-d6ae-4679-a54b-c3069a31e828 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.271922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] The token cache is being invalidate because project 9ed92e1a64cd4d8fb07d40796e274ff4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:09.273566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:09.278874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:09.278874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1055/2087] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:08 2022] DELETE /identity/v3/projects/9ed92e1a64cd4d8fb07d40796e274ff4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:09.279257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.281110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:09.409196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e157ac5d-4336-4411-9e12-fd9ed45c2a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.410167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157ac5d-4336-4411-9e12-fd9ed45c2a9c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.412456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157ac5d-4336-4411-9e12-fd9ed45c2a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.415305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e157ac5d-4336-4411-9e12-fd9ed45c2a9c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.417083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157ac5d-4336-4411-9e12-fd9ed45c2a9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.419311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e157ac5d-4336-4411-9e12-fd9ed45c2a9c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.467562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c26b0c-80a0-46ab-ab11-1cd293f180af admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.491100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.495156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.496275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.498143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.498871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.500529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.509298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1033/2088] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/projects => generated 379 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:09.510745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.516033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.518979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.542229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1056/2089] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:09.544287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.548220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:09.558914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:09.560160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:09.579820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762171dc-a2c3-4915-90e0-2f7e9eec0e60 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.604723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:09.630668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:09.656735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1034/2090] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:09.657901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.668968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70721ae-eec2-406c-8361-67ee8ec54259 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.674748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a75b95-251b-4df1-bf7b-8e847e96cf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.675507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75b95-251b-4df1-bf7b-8e847e96cf67 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.675852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75b95-251b-4df1-bf7b-8e847e96cf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.676130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a75b95-251b-4df1-bf7b-8e847e96cf67 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.676951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a75b95-251b-4df1-bf7b-8e847e96cf67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.678723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a75b95-251b-4df1-bf7b-8e847e96cf67 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.694648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1035/2091] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:09.696376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.696670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.696953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.703289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.704380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.705016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.705496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.706816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.710681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.721886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:09.723322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:09.736324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1036/2092] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:09.737059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.753745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1057/2093] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:09.753745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.762649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de472c2-1fbf-4d36-a803-9808015619ec None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.768405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.769211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.769394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.769668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] PATH_INFO: `/v3/projects/d40b8992505d453e9ed09442d94d551f/users/6a2be8f2d85e4322bac1a33da7c1a1f8/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.773192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c53a5f-daa1-4c49-ada5-dd7fe2c6a288 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.781609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.783921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.784963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.785262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.785955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:09.786502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.788420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f86807f-14af-467f-b15f-2465be0bb695 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.788814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40b8992505d453e9ed09442d94d551f, user_id=6a2be8f2d85e4322bac1a33da7c1a1f8, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.792641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.804602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1058/2094] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:09.808193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1a1d-70d3-4a59-ab34-8b5a1d5eea47 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.808662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1a1d-70d3-4a59-ab34-8b5a1d5eea47 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.809090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b1a1d-70d3-4a59-ab34-8b5a1d5eea47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.817521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1037/2095] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:09 2022] PUT /identity/v3/projects/d40b8992505d453e9ed09442d94d551f/users/6a2be8f2d85e4322bac1a33da7c1a1f8/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:09.818613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.843238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-3b0b1a1d-70d3-4a59-ab34-8b5a1d5eea47 None None] MFA Rules not processed for user `c470cb11a9cd46a0b1e4938ccb1995f1`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:09.844704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3b0b1a1d-70d3-4a59-ab34-8b5a1d5eea47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:09.909015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b6560-4e7e-4bec-8097-fbf414351023 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.918962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.919715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.920098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.920490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.921247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.923127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.941621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1038/2096] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:09.941819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1059/2097] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:09.941819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.941819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.941819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.943107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:09.960451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323d3f0-9861-45c2-886d-9f870cdd22f8 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:09.965533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:09.966155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:09.966454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:09.966738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:09.967384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:09.969320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:09.980623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] MFA Rules not processed for user `6a2be8f2d85e4322bac1a33da7c1a1f8`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:09.982406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:10.003712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1039/2098] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:10.004783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.073559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1060/2099] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:09 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:10.074641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.076097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:10.083052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c7b4e7-c4e9-4c73-8caa-4e44cc82c136 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.088673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.089413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.090179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.090179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] PATH_INFO: `/v3/projects/3af152e707554a74a79969a97b677345/users/751000c6718c4713b0fef781033b6afd/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.091050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:10.109456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af152e707554a74a79969a97b677345, user_id=751000c6718c4713b0fef781033b6afd, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.111947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.136836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1040/2100] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:10 2022] PUT /identity/v3/projects/3af152e707554a74a79969a97b677345/users/751000c6718c4713b0fef781033b6afd/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:10.138097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.150838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:10.202498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414d288-b96d-4efb-a960-b45c15fb62ed None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.239061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb9ce27-87f0-463f-b6d5-d7c8e20973ea admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.253500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.268404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.268802 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.269089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.269767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.271755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.311937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1041/2101] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:10 2022] POST /identity/v3/users => generated 293 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:10.311937 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.315637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.316303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.316891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.316891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.319396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:10.339152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f664be20-ebd7-44b8-a3ae-b167cfa72469 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.344890 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.345499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.345780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.346610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.347323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.349901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.384313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1042/2102] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:10 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:10.384313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.395154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.396755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.407199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1061/2103] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:10.408021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.418602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcd0f3-ba87-4424-bde5-e6da8cc43efc service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.460979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbfe593-6300-4da3-9ab7-cbd6876a4a4c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.466182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:10.468841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.469746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.470752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.471140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.471979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.474354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.488396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.489010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.489298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.489828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.490609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.494154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.507159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1043/2104] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:10.507159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.516402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1062/2105] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:10.516402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.517154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a0956-9928-43d7-b6ed-bb5fc69ee779 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.525029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.525873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.526300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.526828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fe588a-a0d6-49ad-a6e1-013bf2bc5f16 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.527082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.528095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.530061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.544544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.546885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.547314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.548977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] PATH_INFO: `/v3/projects/3af152e707554a74a79969a97b677345/users/751000c6718c4713b0fef781033b6afd/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.550780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3af152e707554a74a79969a97b677345, user_id=751000c6718c4713b0fef781033b6afd, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.553810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.577368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1063/2106] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:10 2022] PUT /identity/v3/projects/3af152e707554a74a79969a97b677345/users/751000c6718c4713b0fef781033b6afd/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:10.578273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.581289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1044/2107] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:10 2022] POST /identity/v3/users => generated 300 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:10.585200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.597091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e283e1-dd25-426e-8937-0aa6c38abcd6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.683686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b766c-4e28-48a9-b8b7-8116f0cd9109 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.688664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:10.689877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2e6c16-2548-48b6-9837-781de90b76a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.690690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e6c16-2548-48b6-9837-781de90b76a5 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.691138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e6c16-2548-48b6-9837-781de90b76a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.691420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2e6c16-2548-48b6-9837-781de90b76a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.692371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e6c16-2548-48b6-9837-781de90b76a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.694242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2e6c16-2548-48b6-9837-781de90b76a5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.699420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.699678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.700078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.700478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.701789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.711327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1064/2108] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:10.711327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cade1-a49d-4422-9b7c-c2f57d9184f8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.711327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cade1-a49d-4422-9b7c-c2f57d9184f8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.712136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.712226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90cade1-a49d-4422-9b7c-c2f57d9184f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.722674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1045/2109] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:10.724236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.737338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde8018f-fcf3-47f3-b5bd-9e304a12a601 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.746268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.747153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.747509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.748003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] PATH_INFO: `/v3/projects/8c2b593e95d043548ad41bd800334b19/users/c5a7fef69e9844ac95dac0bd23c2ce5b/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.770452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c2b593e95d043548ad41bd800334b19, user_id=c5a7fef69e9844ac95dac0bd23c2ce5b, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.774435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.800709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1046/2110] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:10 2022] PUT /identity/v3/projects/8c2b593e95d043548ad41bd800334b19/users/c5a7fef69e9844ac95dac0bd23c2ce5b/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:10.801289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.812392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e90cade1-a49d-4422-9b7c-c2f57d9184f8 None None] MFA Rules not processed for user `751000c6718c4713b0fef781033b6afd`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:10.813623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e90cade1-a49d-4422-9b7c-c2f57d9184f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:10.910668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b8f64e-3f6b-4ada-9d9a-7c8193f5d936 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:10.917066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:10.917893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.918335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.918645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] PATH_INFO: `/v3/projects/07e0e01a5cd245a89cbccedf8f738239/users/cfbbd5c54cbd4b5c980aa8684af5a273/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.919482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1065/2111] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:10 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:10.920587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:10.920888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:10.921427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:10.947669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e0e01a5cd245a89cbccedf8f738239, user_id=cfbbd5c54cbd4b5c980aa8684af5a273, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:10.952973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:10.969392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1047/2112] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:10 2022] PUT /identity/v3/projects/07e0e01a5cd245a89cbccedf8f738239/users/cfbbd5c54cbd4b5c980aa8684af5a273/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:10.971080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:10.971421 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] MFA Rules not processed for user `c5a7fef69e9844ac95dac0bd23c2ce5b`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:10.972940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:10.973282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:11.045129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:11.075319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d0a6b0-0908-45b3-8b82-503beb1fc480 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.079862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.080652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.081029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.081453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.094147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1066/2113] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:11.098974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.277545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cba391-3448-4bd1-9853-9dc919fc27bb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.286679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.287642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.287905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.288505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.288977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.292223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.293356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.295581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.319808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:11.324532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1067/2114] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:11.327847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.354830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1048/2115] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:10 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:11.356034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.360035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962151c9-9337-463f-8c13-3e1a5dcc90bb admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.380779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.381034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324be477-32ca-4f22-bcde-f4a704be977b service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.381427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.384042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.384454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.385617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.388280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b758e70-973a-4180-8deb-76391d2e3a70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.388953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758e70-973a-4180-8deb-76391d2e3a70 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.389533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758e70-973a-4180-8deb-76391d2e3a70 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.389986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b758e70-973a-4180-8deb-76391d2e3a70 admin admin] PATH_INFO: `/v3/projects/07e0e01a5cd245a89cbccedf8f738239/users/cfbbd5c54cbd4b5c980aa8684af5a273/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.390499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.397373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758e70-973a-4180-8deb-76391d2e3a70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=07e0e01a5cd245a89cbccedf8f738239, user_id=cfbbd5c54cbd4b5c980aa8684af5a273, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.401327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b758e70-973a-4180-8deb-76391d2e3a70 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.439551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1049/2116] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:11 2022] PUT /identity/v3/projects/07e0e01a5cd245a89cbccedf8f738239/users/cfbbd5c54cbd4b5c980aa8684af5a273/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:11.451700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.452594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1068/2117] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:11 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:11.455751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.455751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.456862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.554187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] MFA Rules not processed for user `cfbbd5c54cbd4b5c980aa8684af5a273`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:11.556301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:11.573891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d32d3e-f370-46a6-8393-646d2f230472 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.584556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.589303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.590081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.590376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.592605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.597329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.645364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1069/2118] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:11 2022] POST /identity/v3/users => generated 300 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:11.650927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.674061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1050/2119] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:11.676228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2d894c-4756-46e2-9169-a1feacaa0e5a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.686804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.687718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.687999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.688499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.689285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.691596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.692050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.705032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1070/2120] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:11.710834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.756386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6219584-6596-48cc-9f4d-04b684c67f3f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.776095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.777479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.778038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.778596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] PATH_INFO: `/v3/projects/7aea5109722641c9a26dfee9ffaa9ed6/users/a3d1d5f42a4447b786ab1330d695598b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.787962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c40ecc-9bae-48f2-9248-d98433a83a37 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.792679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:11.794358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:11.794649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:11.794984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:11.810593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aea5109722641c9a26dfee9ffaa9ed6, user_id=a3d1d5f42a4447b786ab1330d695598b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.813347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.818668 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:11.820099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:11.834589 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1051/2121] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:11.844801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1071/2122] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:11 2022] PUT /identity/v3/projects/7aea5109722641c9a26dfee9ffaa9ed6/users/a3d1d5f42a4447b786ab1330d695598b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:11.849015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.891610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb8700-ca96-42ce-b091-edf826a035ea service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:11.966826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:11.979136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:12.067971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.068513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.068843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.069059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.069717 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.075794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.100805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1052/2123] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:11 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:12.102261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:12.122155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c126ec-5a54-4fe3-b08f-62b6a92d1bea admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:12.128347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d4666f-c0a7-46a0-8b6d-991f86b941bf admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:12.128659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751000c6718c4713b0fef781033b6afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af152e707554a74a79969a97b677345', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.129563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.136073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.136418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.137161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:12.137456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.139118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e97116-1a10-48b2-968a-2e2b41f402a0 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.139346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.140028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.140318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.141916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] PATH_INFO: `/v3/projects/7aea5109722641c9a26dfee9ffaa9ed6/users/a3d1d5f42a4447b786ab1330d695598b/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.149025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aea5109722641c9a26dfee9ffaa9ed6, user_id=a3d1d5f42a4447b786ab1330d695598b, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.152636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.159946 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:12.171159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1053/2124] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:12 2022] PUT /identity/v3/projects/7aea5109722641c9a26dfee9ffaa9ed6/users/a3d1d5f42a4447b786ab1330d695598b/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:12.174542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:12.181271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1072/2125] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:28:12.188539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.188830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.189108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.262334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] MFA Rules not processed for user `a3d1d5f42a4447b786ab1330d695598b`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:12.264131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:12.376606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b876b90-653c-44ee-84ce-5081fbbddcc0 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:12.387533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751000c6718c4713b0fef781033b6afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af152e707554a74a79969a97b677345', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.389410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.390813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.391167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.391840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.399643 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.459596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1073/2127] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:12 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:12.463612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1054/2127] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:12 2022] POST /identity/v3/projects => generated 354 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:12.464991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:12.483296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774377d0-5cad-428f-a25e-cdf267284135 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:12.488928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:12.559851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751000c6718c4713b0fef781033b6afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af152e707554a74a79969a97b677345', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.560587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.560968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.561309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.562050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:12.562428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.564146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386cc4a0-13c7-4f1b-9697-742df8907e97 tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.576843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1074/2128] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:12.578397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9472292b-6d34-4a2f-ade6-b5dbcf5b4bfd tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:12.581445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.581813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.582245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.582354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.582951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.583260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.583586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.603410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] MFA Rules not processed for user `ea51bd0d578b41ec8851804fe75dde30`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:12.604618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:12.625619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:12.686684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.688496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.698900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1075/2129] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:12.703139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1055/2130] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:12 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:12.703139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:12.713692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15135b1-5184-45a3-91af-7d5551f2f614 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:12.719854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '751000c6718c4713b0fef781033b6afd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3af152e707554a74a79969a97b677345', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:12.720462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:12.720870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:12.721249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] PATH_INFO: `/v3/projects/98dff1a72b934d31ac2102224bf616d3` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:12.723288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorizing `identity:delete_project(project_id=98dff1a72b934d31ac2102224bf616d3)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:12.726075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:12.789989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:12.814745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98dff1a72b934d31ac2102224bf616d3', 'request_id': 'req-916ad384-6ad4-4b07-9fe5-6bccad46579b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:12.832654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98dff1a72b934d31ac2102224bf616d3', 'request_id': 'req-916ad384-6ad4-4b07-9fe5-6bccad46579b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:12.850007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98dff1a72b934d31ac2102224bf616d3', 'request_id': 'req-916ad384-6ad4-4b07-9fe5-6bccad46579b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:12.860703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] The token cache is being invalidate because project 98dff1a72b934d31ac2102224bf616d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:12.861004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:12.861679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-916ad384-6ad4-4b07-9fe5-6bccad46579b tempest-VolumeQuotaClassesTest-623898445 tempest-VolumeQuotaClassesTest-623898445-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:12.863481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1056/2131] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:12 2022] DELETE /identity/v3/projects/98dff1a72b934d31ac2102224bf616d3 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:12.884509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:12.974060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301581ac-c246-49da-aefe-ec9ebd785c90 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:13.043140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:13.044080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.044389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.044713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] PATH_INFO: `/v3/users/c5a7fef69e9844ac95dac0bd23c2ce5b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.046275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5a7fef69e9844ac95dac0bd23c2ce5b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:13.048866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:13.110475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5a7fef69e9844ac95dac0bd23c2ce5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.111310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5a7fef69e9844ac95dac0bd23c2ce5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.126608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5a7fef69e9844ac95dac0bd23c2ce5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.135700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5a7fef69e9844ac95dac0bd23c2ce5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.138248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:13.146815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5a7fef69e9844ac95dac0bd23c2ce5b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.155298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1076/2132] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:12 2022] DELETE /identity/v3/users/c5a7fef69e9844ac95dac0bd23c2ce5b => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:13.160271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.160559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.160835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.184886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:13.186522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.296599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1057/2133] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:13.309059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:13.310510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.377955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:13.380418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.409969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e5d9d-c4d7-4006-ba29-3afdda10a83c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:13.418456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:13.419523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.420439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.421102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] PATH_INFO: `/v3/users/6a2be8f2d85e4322bac1a33da7c1a1f8` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.433741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a2be8f2d85e4322bac1a33da7c1a1f8)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:13.437075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:13.457993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258d9d91-72f3-4dfc-b629-d50b3bfb935a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:13.463707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:13.464432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.464738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.464972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.488350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:13.491229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:13.510604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1077/2134] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:13.512576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:13.513655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a2be8f2d85e4322bac1a33da7c1a1f8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.514664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.529729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a2be8f2d85e4322bac1a33da7c1a1f8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.542133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a2be8f2d85e4322bac1a33da7c1a1f8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.543417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a2be8f2d85e4322bac1a33da7c1a1f8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.544364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e9b377-d10f-4aac-a536-9f68a648f839 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:13.551511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:13.552774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.553203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.553624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] PATH_INFO: `/v3/users/060b4c24a34a4e3aa6a9775581c3a7f7` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.553984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-33c3f8d9-43c9-4c9c-bb27-93a25b53d3d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a2be8f2d85e4322bac1a33da7c1a1f8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.555108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=060b4c24a34a4e3aa6a9775581c3a7f7)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:13.557847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:13.565344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1058/2135] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:13 2022] DELETE /identity/v3/users/6a2be8f2d85e4322bac1a33da7c1a1f8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:13.567862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77756-089a-4b8f-a815-21bb52081e28 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.568134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77756-089a-4b8f-a815-21bb52081e28 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.568405 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b77756-089a-4b8f-a815-21bb52081e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.598148 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d9b77756-089a-4b8f-a815-21bb52081e28 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:13.599583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d9b77756-089a-4b8f-a815-21bb52081e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.639032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:13.660181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060b4c24a34a4e3aa6a9775581c3a7f7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.662332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060b4c24a34a4e3aa6a9775581c3a7f7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.689140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060b4c24a34a4e3aa6a9775581c3a7f7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.702261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060b4c24a34a4e3aa6a9775581c3a7f7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.713418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060b4c24a34a4e3aa6a9775581c3a7f7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:13.714697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1059/2136] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:13.720234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1078/2137] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:13 2022] DELETE /identity/v3/users/060b4c24a34a4e3aa6a9775581c3a7f7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:13.725180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.725528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.725897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.734260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:13.737260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.761250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:13.763030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.857190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669395d6-2b6c-4fb4-b448-bb03f7be8e48 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:13.871725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:13.873221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:13.874167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:13.875029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:13.886109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.918407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1060/2138] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:13.935403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:13.942278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:13.984653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:14.012353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6fe0ac-20ed-4e07-a6fb-2fed70a288d2 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:14.050513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:14.057830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:14.062838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:14.063899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:14.064366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:14.067154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:14.088225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:14.091527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:14.109104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1079/2139] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:14.135716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1061/2140] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:14.227411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:14.229894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:14.252183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57530231-1d57-4732-9b1e-683ca76742c8 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:14.269944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:14.271820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:14.272538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:14.273517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] PATH_INFO: `/v3/projects/8c2b593e95d043548ad41bd800334b19` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:14.276467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c2b593e95d043548ad41bd800334b19)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:14.278886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:14.407698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c2b593e95d043548ad41bd800334b19', 'request_id': 'req-4b30878d-1128-4d81-ab25-7a22ccad48a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.432217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c2b593e95d043548ad41bd800334b19', 'request_id': 'req-4b30878d-1128-4d81-ab25-7a22ccad48a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.447090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c2b593e95d043548ad41bd800334b19', 'request_id': 'req-4b30878d-1128-4d81-ab25-7a22ccad48a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.460737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] The token cache is being invalidate because project 8c2b593e95d043548ad41bd800334b19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:14.461786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.462357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.466874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1080/2141] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:14 2022] DELETE /identity/v3/projects/8c2b593e95d043548ad41bd800334b19 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:14.468164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:14.484653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af876c-9185-49b8-9070-e00dfe219fd2 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:14.584166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:14.585365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:14.585365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:14.585558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] PATH_INFO: `/v3/users/a3d1d5f42a4447b786ab1330d695598b` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:14.587688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3d1d5f42a4447b786ab1330d695598b)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:14.590451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:14.663836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3d1d5f42a4447b786ab1330d695598b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.676020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:14.702879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3d1d5f42a4447b786ab1330d695598b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.718518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3d1d5f42a4447b786ab1330d695598b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.720919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3d1d5f42a4447b786ab1330d695598b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.731091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3d1d5f42a4447b786ab1330d695598b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:14.741242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1062/2142] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:14 2022] DELETE /identity/v3/users/a3d1d5f42a4447b786ab1330d695598b => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:14.848933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:14.851000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:14.875463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:14.877167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:14.889691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30878d-1128-4d81-ab25-7a22ccad48a0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:15.024854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:15.025612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.026067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.026376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] PATH_INFO: `/v3/projects/d40b8992505d453e9ed09442d94d551f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.027638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40b8992505d453e9ed09442d94d551f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:15.029630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:15.094438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b384f6c-6598-453a-92f1-fa5b7836c539 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:15.107507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:15.125321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40b8992505d453e9ed09442d94d551f', 'request_id': 'req-9205d8d1-f300-4aaa-88ee-dd040fa76fea'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.150755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40b8992505d453e9ed09442d94d551f', 'request_id': 'req-9205d8d1-f300-4aaa-88ee-dd040fa76fea'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.160306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40b8992505d453e9ed09442d94d551f', 'request_id': 'req-9205d8d1-f300-4aaa-88ee-dd040fa76fea'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.182987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] The token cache is being invalidate because project d40b8992505d453e9ed09442d94d551f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:15.183366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.184974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.186919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1081/2143] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:14 2022] DELETE /identity/v3/projects/d40b8992505d453e9ed09442d94d551f => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:15.195218 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:15.204757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:15.248628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:15.248983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.249266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.249546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] PATH_INFO: `/v3/projects/d98ef1ec06e64888bbaa689dcb2fd427` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.251834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d98ef1ec06e64888bbaa689dcb2fd427)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:15.255985 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:15.312738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9205d8d1-f300-4aaa-88ee-dd040fa76fea admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:15.318150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:15.318835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.319115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.319433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] PATH_INFO: `/v3/projects/7aea5109722641c9a26dfee9ffaa9ed6` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.320639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aea5109722641c9a26dfee9ffaa9ed6)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:15.322974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:15.342142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd98ef1ec06e64888bbaa689dcb2fd427', 'request_id': 'req-57d9bb81-7f66-4368-9135-0b726bd23131'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.349158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd98ef1ec06e64888bbaa689dcb2fd427', 'request_id': 'req-57d9bb81-7f66-4368-9135-0b726bd23131'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.359031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd98ef1ec06e64888bbaa689dcb2fd427', 'request_id': 'req-57d9bb81-7f66-4368-9135-0b726bd23131'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.376389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] The token cache is being invalidate because project d98ef1ec06e64888bbaa689dcb2fd427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:15.376708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.378301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aea5109722641c9a26dfee9ffaa9ed6', 'request_id': 'req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.378432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.380113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1063/2144] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:14 2022] DELETE /identity/v3/projects/d98ef1ec06e64888bbaa689dcb2fd427 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:15.384280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:15.385511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aea5109722641c9a26dfee9ffaa9ed6', 'request_id': 'req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.385819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:15.398411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aea5109722641c9a26dfee9ffaa9ed6', 'request_id': 'req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.410677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:15.412516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] The token cache is being invalidate because project 7aea5109722641c9a26dfee9ffaa9ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:15.412816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.413525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.416038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1082/2145] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:15 2022] DELETE /identity/v3/projects/7aea5109722641c9a26dfee9ffaa9ed6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:15.416917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:15.419109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:15.492712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d9bb81-7f66-4368-9135-0b726bd23131 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:15.532488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6cfd4c-e2ca-4085-8a96-7d917ca9d93f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:15.541049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:15.541779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.542072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.542354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] PATH_INFO: `/v3/users/751000c6718c4713b0fef781033b6afd` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.543568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=751000c6718c4713b0fef781033b6afd)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:15.546048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:15.547912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:15.642418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '751000c6718c4713b0fef781033b6afd'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.643282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '751000c6718c4713b0fef781033b6afd'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.653469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:15.654128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.654412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.654735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] PATH_INFO: `/v3/users/cfbbd5c54cbd4b5c980aa8684af5a273` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.655939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfbbd5c54cbd4b5c980aa8684af5a273)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:15.657894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:15.675527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '751000c6718c4713b0fef781033b6afd'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.684201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '751000c6718c4713b0fef781033b6afd'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.692213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-36b5d3d1-6d11-40ba-8999-f58a42b82e7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '751000c6718c4713b0fef781033b6afd'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.699429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1083/2146] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:15 2022] DELETE /identity/v3/users/751000c6718c4713b0fef781033b6afd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:15.703532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.703820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.704091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.719232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfbbd5c54cbd4b5c980aa8684af5a273'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.725987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:15.727886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:15.741735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfbbd5c54cbd4b5c980aa8684af5a273'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.754871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfbbd5c54cbd4b5c980aa8684af5a273'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.763065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfbbd5c54cbd4b5c980aa8684af5a273'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.779080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-9bb1c774-2aa0-4d97-b2a3-064d747d0df8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfbbd5c54cbd4b5c980aa8684af5a273'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:15.791764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1064/2147] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:15 2022] DELETE /identity/v3/users/cfbbd5c54cbd4b5c980aa8684af5a273 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:15.815249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1084/2148] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:15.823904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:15.823904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:15.824167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:15.853783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:15.854974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:15.946897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:15.990944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1065/2149] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:15.995628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.012233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6802b7b9-6d52-4959-8ade-0a61988b520f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.026279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.027056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.027355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.027642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.028339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:16.028664 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.032830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.082642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1085/2150] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:16.086143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.106467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7945d936-e042-4f0b-adfb-535700014e76 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.113458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.114183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.114486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.114797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.115453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.119671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.121344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.122316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.151925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3cc8d4-40cf-46f0-8da9-40ee084286bd admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.158923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.159579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.160020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.161339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] PATH_INFO: `/v3/projects/3af152e707554a74a79969a97b677345` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.162555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3af152e707554a74a79969a97b677345)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.165458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.207928 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1066/2151] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/projects => generated 391 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:16.212335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.290061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3af152e707554a74a79969a97b677345', 'request_id': 'req-f082ab8c-e8d5-465d-90aa-d0be2877b863'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.309422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3af152e707554a74a79969a97b677345', 'request_id': 'req-f082ab8c-e8d5-465d-90aa-d0be2877b863'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.318249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:16.320737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae743d3-ec5d-4fe4-8436-8387c3e08874 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.330412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3af152e707554a74a79969a97b677345', 'request_id': 'req-f082ab8c-e8d5-465d-90aa-d0be2877b863'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.350733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] The token cache is being invalidate because project 3af152e707554a74a79969a97b677345 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:16.351061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.352586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f082ab8c-e8d5-465d-90aa-d0be2877b863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.354929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1086/2152] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:16 2022] DELETE /identity/v3/projects/3af152e707554a74a79969a97b677345 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:16.360290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.360591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.360865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.388066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:16.389644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.457359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f94f0d-8782-4d05-86ca-e786c730c48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.458411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94f0d-8782-4d05-86ca-e786c730c48c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.459285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94f0d-8782-4d05-86ca-e786c730c48c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.460360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f94f0d-8782-4d05-86ca-e786c730c48c admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.463611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f94f0d-8782-4d05-86ca-e786c730c48c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.466132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f94f0d-8782-4d05-86ca-e786c730c48c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.494224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1087/2153] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:16.494224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.494224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.508263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077134ca-5603-4d58-a151-ea7ca722764d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.515551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1067/2154] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/users => generated 296 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:28:16.517649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.517978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.518262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.527927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.528982 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.529850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.530482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] PATH_INFO: `/v3/projects/07e0e01a5cd245a89cbccedf8f738239` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.538909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] RBAC: Authorizing `identity:delete_project(project_id=07e0e01a5cd245a89cbccedf8f738239)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.544609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.570982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:16.572184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.580725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1068/2155] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:16.585749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.587768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.605606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f773d1-dbcf-4b91-87e9-841f383a3450 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.625484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07e0e01a5cd245a89cbccedf8f738239', 'request_id': 'req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.631960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07e0e01a5cd245a89cbccedf8f738239', 'request_id': 'req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.643966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07e0e01a5cd245a89cbccedf8f738239', 'request_id': 'req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.671159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] The token cache is being invalidate because project 07e0e01a5cd245a89cbccedf8f738239 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:16.671469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.672908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:16.681424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1088/2156] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:16 2022] DELETE /identity/v3/projects/07e0e01a5cd245a89cbccedf8f738239 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:16.682464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.685384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.707391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:16.730992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59db9225-e496-4d73-ac78-da2b3d2538f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.731650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9225-e496-4d73-ac78-da2b3d2538f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.731954 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9225-e496-4d73-ac78-da2b3d2538f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.732373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59db9225-e496-4d73-ac78-da2b3d2538f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.733556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9225-e496-4d73-ac78-da2b3d2538f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.735227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59db9225-e496-4d73-ac78-da2b3d2538f2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.752408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1069/2157] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:16.754061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.754360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.754642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.782653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:16.783979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.795104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1070/2158] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:16.795844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.797156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.804010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e199c4e4-4d56-40c6-8769-6bd9ca07a05a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.811000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.812191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.812691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.813159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.814134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:16.814409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb909d5-a1d2-428d-b80a-8154ca565d37 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.814862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.816957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d8a274-be9d-4bd5-bb0e-9729b8f459f7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.819559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.820361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.820880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.821424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.822383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.825391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.833017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1089/2159] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:16.834919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.835433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.835987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.840598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1071/2160] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:16 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:16.840598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.851088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af9da05-e457-434f-b267-a11e42ce6fc9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.860107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:16.863174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.863828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.864910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.864910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.865271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.868053 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:16.868193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.869962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:16.880665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1090/2161] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:16.881747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.894338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24446f-26ae-45eb-a968-260c3065fa0a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:16.900742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:16.901779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:16.901779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:16.901984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] PATH_INFO: `/v3/projects/3fa938ef96a14b77888f7dfb44866b61/users/ac74b1133d7c4994b3df1c3d1405035b/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:16.910767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1072/2162] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/projects => generated 361 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:16.910767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:16.921301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fa938ef96a14b77888f7dfb44866b61, user_id=ac74b1133d7c4994b3df1c3d1405035b, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:16.924134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:16.946304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1091/2163] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:16 2022] PUT /identity/v3/projects/3fa938ef96a14b77888f7dfb44866b61/users/ac74b1133d7c4994b3df1c3d1405035b/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:16.946304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.032389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fd779-9448-4309-880a-15ec7ed0082d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.049029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1607dffd-8dab-4fda-ab17-fa3d6a9f7b40 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.053975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192f7fb7-13fc-4019-bc67-1838607cadaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.054671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f7fb7-13fc-4019-bc67-1838607cadaa admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.055217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f7fb7-13fc-4019-bc67-1838607cadaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.055576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192f7fb7-13fc-4019-bc67-1838607cadaa admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.056295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f7fb7-13fc-4019-bc67-1838607cadaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.058300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192f7fb7-13fc-4019-bc67-1838607cadaa admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.095449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1092/2164] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:16 2022] POST /identity/v3/users => generated 281 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:17.095449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.095449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.095449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.126936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.127558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.127845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.128122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.128787 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:17.129095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.130734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.137827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] MFA Rules not processed for user `ac74b1133d7c4994b3df1c3d1405035b`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:17.139107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:17.145994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1073/2165] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:17.145994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.161467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e804c1c-ab72-4ebc-9dc9-f6a3d59408fc admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.168568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3a1ffe-f5de-4917-8c55-1404989d1950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.169242 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1ffe-f5de-4917-8c55-1404989d1950 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.170096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1ffe-f5de-4917-8c55-1404989d1950 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.170486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3a1ffe-f5de-4917-8c55-1404989d1950 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.171082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a1ffe-f5de-4917-8c55-1404989d1950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.173378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3a1ffe-f5de-4917-8c55-1404989d1950 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.187085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1074/2166] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:17.188628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635fc12-b05e-4057-90d8-4c0f78f25b0e None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.189410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635fc12-b05e-4057-90d8-4c0f78f25b0e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.189744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5635fc12-b05e-4057-90d8-4c0f78f25b0e None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.192448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1075/2167] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:28:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:28:17.193974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635fc12-b05e-4057-90d8-4c0f78f25b0e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.210791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5635fc12-b05e-4057-90d8-4c0f78f25b0e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.216842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.217452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.217740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.218022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.218662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.219081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1093/2168] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:17.220061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.220784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.231907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd2fbbf-707a-4282-97ca-72d3f1133fdb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.237440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac598-846b-433c-8a56-0b4365a3537f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.238158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac598-846b-433c-8a56-0b4365a3537f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.238515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac598-846b-433c-8a56-0b4365a3537f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.239597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac598-846b-433c-8a56-0b4365a3537f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.239597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac598-846b-433c-8a56-0b4365a3537f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.241475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac598-846b-433c-8a56-0b4365a3537f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.257263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1094/2169] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:17.257263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.257263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.257263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.257779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1076/2170] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:17.257779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.272017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:17.278928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] MFA Rules not processed for user `ee2a386cf6c549c59051ee161f9a1d3c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:17.280521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:17.329867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:17.348285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cf3c67-5108-461f-b4d8-a1e1c586b7af admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.354032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.355082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.355596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.356193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.357712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.360154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.360303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1095/2171] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:17.361202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.373376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96be2714-3cf4-43a6-9011-4cba9e1c9560 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.378463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.379124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.379407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.379687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.380461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.382502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.407644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1096/2172] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:17.408715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.409012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1077/2173] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/projects => generated 391 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:17.411722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.414230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:17.425772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5592095f-3092-4f31-b630-74e863406b9a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.525256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe350c1-cdd4-4538-b718-515334ff4ded admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.526407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.527394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.527887 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.528342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] PATH_INFO: `/v3/projects/89c9beb9bd424218905dfc462903779c/users/93f8715e0d7844f9a2ad3ce507bf3002/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.533878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.534541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.534978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.535267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.546864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.548661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.554981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89c9beb9bd424218905dfc462903779c, user_id=93f8715e0d7844f9a2ad3ce507bf3002, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.558942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.561275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1078/2174] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:17.562250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.575747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106e94a9-2d8d-4bd9-a74e-d913c38c62c0 service placement] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.591718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1097/2175] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:17 2022] PUT /identity/v3/projects/89c9beb9bd424218905dfc462903779c/users/93f8715e0d7844f9a2ad3ce507bf3002/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:17.593010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.657046 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb03798-1e57-4206-a70e-a78a7d397e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.657868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03798-1e57-4206-a70e-a78a7d397e59 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.658372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03798-1e57-4206-a70e-a78a7d397e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.658772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb03798-1e57-4206-a70e-a78a7d397e59 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.659931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03798-1e57-4206-a70e-a78a7d397e59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.662146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb03798-1e57-4206-a70e-a78a7d397e59 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.673108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a66ef3-8aad-4688-ac51-f95a456d8e64 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.674855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1079/2176] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:17.676453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.676998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.677246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.682722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.683516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.684143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.684143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.684747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.686732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.713869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] MFA Rules not processed for user `93f8715e0d7844f9a2ad3ce507bf3002`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:17.714086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:17.716708 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1098/2177] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/users => generated 302 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:17.717979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.748652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:17.750641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2381f-efe8-4f9b-b99d-863971803f7b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.764091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.764091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.764091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.764091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.764365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.764365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.772448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1099/2178] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:17.777360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.787280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafc1331-0079-451c-9f8b-dfe9507cd6cf admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.792538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.793175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.793458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.793732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.794369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.796008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.808209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1100/2179] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:17.808772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.818485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e240be-48ee-4c2e-bdfc-b2ea41791a1f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.821742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1080/2180] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:17.825561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.826399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.826670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.826955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.827075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] PATH_INFO: `/v3/projects/fdbd89685ad74de882441fab9891bc6c/users/61df9b7acb704c5f8a65338a1fae1811/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.845321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:17.849338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e643f78-f9fa-41aa-8950-af2c82accde0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.861520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.862508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.862951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.863139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdbd89685ad74de882441fab9891bc6c, user_id=61df9b7acb704c5f8a65338a1fae1811, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.863264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] PATH_INFO: `/v3/projects/59a3b161c71a413d88558b0dc150fda0/users/36ac38f8cac14fcc89d556029f6e2c0f/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:17.867721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.881944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a3b161c71a413d88558b0dc150fda0, user_id=36ac38f8cac14fcc89d556029f6e2c0f, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:17.883538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1101/2181] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:17 2022] PUT /identity/v3/projects/fdbd89685ad74de882441fab9891bc6c/users/61df9b7acb704c5f8a65338a1fae1811/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:17.884280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.885949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:17.902189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:17.918786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1081/2182] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:17 2022] PUT /identity/v3/projects/59a3b161c71a413d88558b0dc150fda0/users/36ac38f8cac14fcc89d556029f6e2c0f/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:17.920002 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:17.923250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:17.981912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60913c-e1dd-4d79-af93-c3f78ccd8b3a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.991233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d69f6-903e-48a0-894e-8fe2749e1e6b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:17.997641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28068c6-cb1a-4481-b82c-08cca9f2c913 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:17.998478 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28068c6-cb1a-4481-b82c-08cca9f2c913 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:17.998688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28068c6-cb1a-4481-b82c-08cca9f2c913 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:17.999036 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28068c6-cb1a-4481-b82c-08cca9f2c913 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.068991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.069928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.070889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.071403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] PATH_INFO: `/v3/users/89f73cc56d9d48d39847f64f32161e66` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.073399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89f73cc56d9d48d39847f64f32161e66)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.075813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.076587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28068c6-cb1a-4481-b82c-08cca9f2c913 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.079340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28068c6-cb1a-4481-b82c-08cca9f2c913 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.093349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1082/2183] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:18.095988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.096443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.097023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.133701 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] MFA Rules not processed for user `61df9b7acb704c5f8a65338a1fae1811`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:18.135712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.137879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89f73cc56d9d48d39847f64f32161e66'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.138470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89f73cc56d9d48d39847f64f32161e66'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.155393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89f73cc56d9d48d39847f64f32161e66'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.170077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89f73cc56d9d48d39847f64f32161e66'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.179467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89f73cc56d9d48d39847f64f32161e66'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.184023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:18.189882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1102/2184] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:17 2022] DELETE /identity/v3/users/89f73cc56d9d48d39847f64f32161e66 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:18.194320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.197450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.232108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:18.240331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1083/2185] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:18.241321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.243769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.259888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98776d55-3da9-4b25-8962-4c01e1e21c6a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.300146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e017ba2-484b-4980-b7ad-2de22d30b454 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.305765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.306394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.306684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.307482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.308150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.310111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.330826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1103/2186] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:18 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:18.332201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.334936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.347411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.348274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.348660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.349065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] PATH_INFO: `/v3/users/93f8715e0d7844f9a2ad3ce507bf3002` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.350531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f8715e0d7844f9a2ad3ce507bf3002)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.353303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.407784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d52677-0640-4851-9ed6-f295cab8ceb9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.412128 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.412906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.413244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.413581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.431737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f8715e0d7844f9a2ad3ce507bf3002'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.450171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f8715e0d7844f9a2ad3ce507bf3002'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.459953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f8715e0d7844f9a2ad3ce507bf3002'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.460711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f8715e0d7844f9a2ad3ce507bf3002'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.469431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f8715e0d7844f9a2ad3ce507bf3002'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.475796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1084/2187] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:18 2022] DELETE /identity/v3/users/93f8715e0d7844f9a2ad3ce507bf3002 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:18.476584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.478603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.491570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.493700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.504269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1104/2188] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:18.506000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.508630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.534058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473e7e4-7c38-4a2d-a200-762a88cac33c service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.534979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:18.548923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ecf6ab-f08d-434d-b981-4f9e6bc226ff admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.554034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82b3d7-aed7-499e-a0f6-2448c89058b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.555396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b3d7-aed7-499e-a0f6-2448c89058b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.555723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b3d7-aed7-499e-a0f6-2448c89058b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.556034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82b3d7-aed7-499e-a0f6-2448c89058b1 admin admin] PATH_INFO: `/v3/projects/59a3b161c71a413d88558b0dc150fda0/users/36ac38f8cac14fcc89d556029f6e2c0f/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.558126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b3d7-aed7-499e-a0f6-2448c89058b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a3b161c71a413d88558b0dc150fda0, user_id=36ac38f8cac14fcc89d556029f6e2c0f, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.561352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82b3d7-aed7-499e-a0f6-2448c89058b1 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.573469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1085/2189] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:18 2022] PUT /identity/v3/projects/59a3b161c71a413d88558b0dc150fda0/users/36ac38f8cac14fcc89d556029f6e2c0f/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:18.575966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.576382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.576775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.595584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.596185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.596470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.596751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] PATH_INFO: `/v3/projects/1332a20158934e21bb3dd07a3a21c46e` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.598168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1332a20158934e21bb3dd07a3a21c46e)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.600226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.604000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:18.605866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.610057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:18.655177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1332a20158934e21bb3dd07a3a21c46e', 'request_id': 'req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.660601 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1332a20158934e21bb3dd07a3a21c46e', 'request_id': 'req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.669131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1332a20158934e21bb3dd07a3a21c46e', 'request_id': 'req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.682737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1086/2190] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:18.683624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.683784 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] The token cache is being invalidate because project 1332a20158934e21bb3dd07a3a21c46e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:18.684457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.685030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.685437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc2fff37-d3b8-483d-a1a8-05ce6032e3fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.689896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1105/2191] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:18 2022] DELETE /identity/v3/projects/1332a20158934e21bb3dd07a3a21c46e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:18.689896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.689896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.689896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.698414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724eb8f3-56a1-4afd-a338-f8ba86a77370 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.718677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] MFA Rules not processed for user `36ac38f8cac14fcc89d556029f6e2c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:18.719928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.757774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.759105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.759410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.759698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] PATH_INFO: `/v3/users/61df9b7acb704c5f8a65338a1fae1811` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.760896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61df9b7acb704c5f8a65338a1fae1811)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.763077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.809407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1106/2192] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:18.810384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.811781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.834238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d239d-5096-4665-91f9-dd1dc10a61fe None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:18.838255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61df9b7acb704c5f8a65338a1fae1811'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.840874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:18.841577 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:18.841864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:18.842304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] PATH_INFO: `/v3/users/93481c532d314d2a9c792bb77cebc8b9` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:18.843437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93481c532d314d2a9c792bb77cebc8b9)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:18.845838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:18.853445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61df9b7acb704c5f8a65338a1fae1811'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.862905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61df9b7acb704c5f8a65338a1fae1811'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.863583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61df9b7acb704c5f8a65338a1fae1811'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.872410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61df9b7acb704c5f8a65338a1fae1811'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.880675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1087/2193] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:18 2022] DELETE /identity/v3/users/61df9b7acb704c5f8a65338a1fae1811 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:18.881716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.883963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.894220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:18.902129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93481c532d314d2a9c792bb77cebc8b9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.902889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93481c532d314d2a9c792bb77cebc8b9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.921540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93481c532d314d2a9c792bb77cebc8b9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.934715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93481c532d314d2a9c792bb77cebc8b9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.943809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:18.953366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93481c532d314d2a9c792bb77cebc8b9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:18.960654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1107/2194] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:18 2022] DELETE /identity/v3/users/93481c532d314d2a9c792bb77cebc8b9 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:18.962513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:18.964081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:18.965454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea1a88f-f793-4404-88a6-7245c5aa5fc3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.019084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.019888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.020365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.020645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.022623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.029549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e307e3-63f9-49bb-8493-bac7824c1ea6 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.033489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.034106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.034389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.034669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.036457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.094241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.096065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdd4ed3-5bb0-4a82-8e46-889c93b79b32 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.107959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1088/2195] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:19.109259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.109553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.110084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.118952 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.119398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.137205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1108/2196] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:18 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:19.141912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:19.143211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.153512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1089/2197] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:19.166963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.171249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.189256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.190740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.198618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc46c9f-4ca5-4db2-b370-437d2b58ee70 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.207054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.208623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a155a61-6b9d-48b4-a651-d1dff01af844 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.214177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.214872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.215160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.215447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] PATH_INFO: `/v3/projects/94f84d30a54e4775aaa301a676900207` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.216685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.217009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] RBAC: Authorizing `identity:delete_project(project_id=94f84d30a54e4775aaa301a676900207)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.218871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.219083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.219593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.243918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.246737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.293564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1109/2198] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:19.294809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.303278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.329091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd2e36e-b1bc-4e7d-a2e4-9c2f9e5feb77 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.331175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94f84d30a54e4775aaa301a676900207', 'request_id': 'req-b6aeceea-2d31-485f-b160-c94f438de290'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:19.343018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94f84d30a54e4775aaa301a676900207', 'request_id': 'req-b6aeceea-2d31-485f-b160-c94f438de290'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:19.348449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:19.364726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94f84d30a54e4775aaa301a676900207', 'request_id': 'req-b6aeceea-2d31-485f-b160-c94f438de290'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:19.390188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] The token cache is being invalidate because project 94f84d30a54e4775aaa301a676900207 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:19.391250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:19.392087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b6aeceea-2d31-485f-b160-c94f438de290 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:19.399686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1090/2199] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:19 2022] DELETE /identity/v3/projects/94f84d30a54e4775aaa301a676900207 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:19.403123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb456-5ede-491d-819b-e841d7462bbd None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.403502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb456-5ede-491d-819b-e841d7462bbd None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.403768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4fb456-5ede-491d-819b-e841d7462bbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.445219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1c4fb456-5ede-491d-819b-e841d7462bbd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:19.451990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1c4fb456-5ede-491d-819b-e841d7462bbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.492363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.493030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.493266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.493543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.495560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.554894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:19.576317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1091/2200] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:19.579009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.583082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.584765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.585205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.586477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.605340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1110/2201] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:19 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:19.617012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:19.618406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.629276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1092/2202] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:19.634054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.660902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33e7e53-25d0-4f5b-8af1-7835b2b1faf7 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.668373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.669215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.669566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.669906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.670643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:19.671043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.672835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.709337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.716561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1111/2203] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:28:19.722720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e891875-7d28-4cc3-a003-ed8d1ba0ee89 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.730249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.731015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.731491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.731769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.732555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.735486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:19.790276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1093/2204] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:19 2022] POST /identity/v3/projects => generated 375 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:19.795616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.842087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84548a22-52ce-4e2d-b3e9-cd3e2082824b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:19.851267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:19.854300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:19.991576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:19.992356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:19.992749 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:19.993160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:19.993992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:19.996330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.000325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbdbf1d-2b57-4ad7-a1f1-ff14f648a051 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.022733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.022733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.022733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.022733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] PATH_INFO: `/v3/projects/89c9beb9bd424218905dfc462903779c` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.028606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1112/2205] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:19 2022] POST /identity/v3/users => generated 288 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:20.028703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89c9beb9bd424218905dfc462903779c)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.028789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.028900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.028996 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.044040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb46290-f51b-4680-8409-fd62921fbe83 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.049220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.049941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.050301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.050956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] PATH_INFO: `/v3/projects/fdbd89685ad74de882441fab9891bc6c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.052423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdbd89685ad74de882441fab9891bc6c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.054560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.132743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdbd89685ad74de882441fab9891bc6c', 'request_id': 'req-902425f7-d6f4-4f69-aed5-31f4154a6e79'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.141439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdbd89685ad74de882441fab9891bc6c', 'request_id': 'req-902425f7-d6f4-4f69-aed5-31f4154a6e79'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.142886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c9beb9bd424218905dfc462903779c', 'request_id': 'req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.151916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdbd89685ad74de882441fab9891bc6c', 'request_id': 'req-902425f7-d6f4-4f69-aed5-31f4154a6e79'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.158867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c9beb9bd424218905dfc462903779c', 'request_id': 'req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.163527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:20.166394 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] The token cache is being invalidate because project fdbd89685ad74de882441fab9891bc6c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:20.166835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.167617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.169335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1113/2206] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:20 2022] DELETE /identity/v3/projects/fdbd89685ad74de882441fab9891bc6c => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:20.170250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.172427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.177510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c9beb9bd424218905dfc462903779c', 'request_id': 'req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.193677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] The token cache is being invalidate because project 89c9beb9bd424218905dfc462903779c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:20.193961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.194667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-376bc03e-ed1b-42b1-963c-61d9a7bb1a57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:20.197092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1094/2207] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:19 2022] DELETE /identity/v3/projects/89c9beb9bd424218905dfc462903779c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:20.198099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8f36-8494-4729-880d-b857362ef55d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.198382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8f36-8494-4729-880d-b857362ef55d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.198675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc8f36-8494-4729-880d-b857362ef55d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.219420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f0dc8f36-8494-4729-880d-b857362ef55d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:20.220638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f0dc8f36-8494-4729-880d-b857362ef55d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.229175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:20.252903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902425f7-d6f4-4f69-aed5-31f4154a6e79 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.281721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1095/2208] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:20.283863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf55c-1690-4e1c-8414-027ca5e7ae81 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.284286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf55c-1690-4e1c-8414-027ca5e7ae81 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.284675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102bf55c-1690-4e1c-8414-027ca5e7ae81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.307137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-102bf55c-1690-4e1c-8414-027ca5e7ae81 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:20.308353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-102bf55c-1690-4e1c-8414-027ca5e7ae81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.316261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1096/2209] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:20.317432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.317718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.317993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.321381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdadc407-dbb1-4556-90f9-e616047c439b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.322007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc407-dbb1-4556-90f9-e616047c439b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.322292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc407-dbb1-4556-90f9-e616047c439b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.322569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdadc407-dbb1-4556-90f9-e616047c439b admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.323278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc407-dbb1-4556-90f9-e616047c439b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.324883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdadc407-dbb1-4556-90f9-e616047c439b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.335860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1114/2210] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:20.337524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.337826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.338105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.338208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:20.339448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.347515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1097/2211] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:20.348307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.349917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.357671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:20.358882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.361853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20392a2-4a73-497d-8692-a65409c87aa1 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.366373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.366999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.367095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1115/2212] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:20.367310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.367790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.368082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.368694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.373887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.379292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e244200-a842-4087-89d3-9434e1d17cab None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.385024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.385660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.386073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.386356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.387050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:20.387356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.389042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1098/2213] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:20.389149 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.389772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.402733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee69f-b5c1-404e-a5e8-4f49a56fa819 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.403160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1116/2214] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:20.403999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.407801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.408542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.408925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.409203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.409888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:20.410193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.411950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.415489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34075a8c-3c59-4877-90cd-d31629f4e25e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.421240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.421956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.422265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.422566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] PATH_INFO: `/v3/projects/69e1934b48824d8fbe555757c94d22a2/users/ca1c1b1fb2d048a6b6c53077dbae2c6e/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.432775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1099/2215] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:20.432775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.444029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e1934b48824d8fbe555757c94d22a2, user_id=ca1c1b1fb2d048a6b6c53077dbae2c6e, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.447325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652dcdda-3cec-4f82-8ddf-174c9dbbdb6c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.447783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.455993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463e94dd-7748-4e91-947e-4673359d2276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.457197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e94dd-7748-4e91-947e-4673359d2276 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.457713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e94dd-7748-4e91-947e-4673359d2276 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.458342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463e94dd-7748-4e91-947e-4673359d2276 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.459536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e94dd-7748-4e91-947e-4673359d2276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.463485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463e94dd-7748-4e91-947e-4673359d2276 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.463831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1117/2216] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:20 2022] PUT /identity/v3/projects/69e1934b48824d8fbe555757c94d22a2/users/ca1c1b1fb2d048a6b6c53077dbae2c6e/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:20.471661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.497162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1100/2217] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/projects => generated 369 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:20.497162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.497162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.497162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.524126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] MFA Rules not processed for user `ca1c1b1fb2d048a6b6c53077dbae2c6e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:20.525618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.539541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862247ce-f095-406c-9b42-b4226ea89e96 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.585690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:20.593194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1101/2218] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:20.594073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.596743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.597246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.597534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.597811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.598545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.600441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.607870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90f4f9c-0edc-416d-93cb-23ff35346252 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.612670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.613268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.613550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.613823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.614449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.616408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.628788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1118/2219] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:20.629864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.632209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:20.653390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1102/2220] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/users => generated 285 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:20.654214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.661127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:20.665831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c374db9c-2b8f-4f4b-a876-3e2556fbee61 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.721777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0e3357-9a35-4e86-9b17-41f260b1ab3a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.725493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.726097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.726380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.727290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.730256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.730899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.731182 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.731449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.732105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.734078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.756518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1103/2221] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:20.757185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.767854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4c677-5fa8-4966-9e17-f6835316e179 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.774003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.775189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.775413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.775659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.776386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.777999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.790024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1104/2222] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:20.790724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.798277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.799778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.804502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b131dc4-8e4b-40c8-8f28-174c3e987484 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.810249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.810419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1119/2223] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:20.810913 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.811200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.811311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.811476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.812218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.813763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.824077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd73279-9fb4-45ad-b065-0ca621a9ff3e service glance] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.825393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1105/2224] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:20.829306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.829472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.829924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.830207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.830498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.831167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.834754 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.843688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b673f44-c57f-4434-837f-7b31fecda22a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.847570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1120/2225] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:20.848318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.849939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.850774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.858756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dec0939-bd72-4c3f-aab0-e8a93f84ebcc admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.859073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.859525 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.860356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.862831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.865232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1adafd-3b99-4f30-9773-3aa5e309bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.866070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1adafd-3b99-4f30-9773-3aa5e309bd4d admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.866541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1adafd-3b99-4f30-9773-3aa5e309bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.867064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1adafd-3b99-4f30-9773-3aa5e309bd4d admin admin] PATH_INFO: `/v3/projects/d953a1f42e354e77ac7eac713612a4c2/users/d4830a171c8f48ecb34dc29997889bc2/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.878743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1106/2226] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:28:20.881805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:20.897120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80179faf-e4ce-4010-a5cc-a01fad8b682a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:20.900613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1adafd-3b99-4f30-9773-3aa5e309bd4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d953a1f42e354e77ac7eac713612a4c2, user_id=d4830a171c8f48ecb34dc29997889bc2, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.903312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fdf48f-082b-4e5b-afbf-7a6c1367c648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:20.904225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1adafd-3b99-4f30-9773-3aa5e309bd4d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.904350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf48f-082b-4e5b-afbf-7a6c1367c648 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.905733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf48f-082b-4e5b-afbf-7a6c1367c648 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.906119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fdf48f-082b-4e5b-afbf-7a6c1367c648 admin admin] PATH_INFO: `/v3/projects/62c4614b8d96471d9ffea70923f2d721/users/d7161ec7e27c40c7adbc63ea7d7cbd50/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.953118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1121/2227] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:20 2022] PUT /identity/v3/projects/d953a1f42e354e77ac7eac713612a4c2/users/d4830a171c8f48ecb34dc29997889bc2/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:20.953465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdf48f-082b-4e5b-afbf-7a6c1367c648 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62c4614b8d96471d9ffea70923f2d721, user_id=d7161ec7e27c40c7adbc63ea7d7cbd50, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:20.955581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:20.955773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:20.956034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:20.960774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fdf48f-082b-4e5b-afbf-7a6c1367c648 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:20.987279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1107/2228] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:20 2022] PUT /identity/v3/projects/62c4614b8d96471d9ffea70923f2d721/users/d7161ec7e27c40c7adbc63ea7d7cbd50/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:21.000253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:21.000712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:21.001056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:21.019292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] MFA Rules not processed for user `d4830a171c8f48ecb34dc29997889bc2`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:21.020610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:21.033740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] MFA Rules not processed for user `d7161ec7e27c40c7adbc63ea7d7cbd50`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:21.036439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:21.046490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:21.100943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1122/2229] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:21.126591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1108/2230] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:21.127142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:21.170189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:21.171661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:21.190131 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0476076-6792-4e8c-b3b5-f789e5fd8a52 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:21.195189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:21.197557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:21.198435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:21.199032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:21.209074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:21.211114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:21.211681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:21.228783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1123/2231] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:21.267333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54dc6b6-dfbe-42ab-9f23-136c929f9d0b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:21.271202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1453ee-cd7b-4db4-b0d1-3bad7ca8b1b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:21.271811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1453ee-cd7b-4db4-b0d1-3bad7ca8b1b3 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:21.272092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1453ee-cd7b-4db4-b0d1-3bad7ca8b1b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:21.272366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1453ee-cd7b-4db4-b0d1-3bad7ca8b1b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:21.283523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1453ee-cd7b-4db4-b0d1-3bad7ca8b1b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:21.285404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1453ee-cd7b-4db4-b0d1-3bad7ca8b1b3 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:21.296966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1109/2232] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:28:23.700819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:23.702231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:23.782533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d6671-f61b-4b24-b72b-f179f31f700b service glance] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:23.787246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:23.787881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:23.788167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:23.788443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] PATH_INFO: `/v3/users/ac74b1133d7c4994b3df1c3d1405035b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:23.790140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac74b1133d7c4994b3df1c3d1405035b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:23.792185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:23.850546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac74b1133d7c4994b3df1c3d1405035b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:23.851251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac74b1133d7c4994b3df1c3d1405035b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:23.864396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac74b1133d7c4994b3df1c3d1405035b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:23.868434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:23.873170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac74b1133d7c4994b3df1c3d1405035b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:23.884670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac74b1133d7c4994b3df1c3d1405035b'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:23.894747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1124/2233] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:23 2022] DELETE /identity/v3/users/ac74b1133d7c4994b3df1c3d1405035b => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:23.900264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:23.900706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:23.900843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:23.926932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:23.928713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:24.016417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1110/2234] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:24.040020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:24.041717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:24.132129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8e4b53-1bcc-443c-a461-00305a054052 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:24.137010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:24.137631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:24.139598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:24.139598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:24.153269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:24.154801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:24.167126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1125/2235] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:24.602994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:24.604428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:24.623977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63ac07-e2ce-4326-a76c-b67907509aa6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:24.636632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:24.637303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:24.637580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:24.637861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] PATH_INFO: `/v3/projects/3fa938ef96a14b77888f7dfb44866b61` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:24.639049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fa938ef96a14b77888f7dfb44866b61)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:24.641032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:24.691922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fa938ef96a14b77888f7dfb44866b61', 'request_id': 'req-a77b1910-beac-458a-bbf3-991fe7f9fe49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.701370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fa938ef96a14b77888f7dfb44866b61', 'request_id': 'req-a77b1910-beac-458a-bbf3-991fe7f9fe49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.708920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fa938ef96a14b77888f7dfb44866b61', 'request_id': 'req-a77b1910-beac-458a-bbf3-991fe7f9fe49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.720757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] The token cache is being invalidate because project 3fa938ef96a14b77888f7dfb44866b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:24.721039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.721656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.723172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1111/2236] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:24 2022] DELETE /identity/v3/projects/3fa938ef96a14b77888f7dfb44866b61 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:24.727220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:24.736923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ece741e-13e6-4abb-a5f9-973047ed7d65 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:24.800482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:24.802168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:24.802168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:24.802168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] PATH_INFO: `/v3/users/36ac38f8cac14fcc89d556029f6e2c0f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:24.803462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ac38f8cac14fcc89d556029f6e2c0f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:24.806428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:24.858247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ac38f8cac14fcc89d556029f6e2c0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.858936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ac38f8cac14fcc89d556029f6e2c0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.871318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ac38f8cac14fcc89d556029f6e2c0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.878483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ac38f8cac14fcc89d556029f6e2c0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.886539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1198c0-6c07-40f0-ae95-866fd8306e75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ac38f8cac14fcc89d556029f6e2c0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:24.892599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1126/2237] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:24 2022] DELETE /identity/v3/users/36ac38f8cac14fcc89d556029f6e2c0f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:25.220786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.222522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:25.238454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77b1910-beac-458a-bbf3-991fe7f9fe49 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.306070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:25.316903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.317635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.317989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.318336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] PATH_INFO: `/v3/projects/59a3b161c71a413d88558b0dc150fda0` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.319627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a3b161c71a413d88558b0dc150fda0)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.322686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.369679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a3b161c71a413d88558b0dc150fda0', 'request_id': 'req-671a5b75-a851-4962-9fb6-7f7217243186'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:25.375569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a3b161c71a413d88558b0dc150fda0', 'request_id': 'req-671a5b75-a851-4962-9fb6-7f7217243186'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:25.384736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a3b161c71a413d88558b0dc150fda0', 'request_id': 'req-671a5b75-a851-4962-9fb6-7f7217243186'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:25.396184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] The token cache is being invalidate because project 59a3b161c71a413d88558b0dc150fda0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:25.396480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:25.397179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-671a5b75-a851-4962-9fb6-7f7217243186 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:25.399822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1112/2238] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:25 2022] DELETE /identity/v3/projects/59a3b161c71a413d88558b0dc150fda0 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:25.404370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.404663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.404950 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.428048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:25.430051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:25.435298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:25.510538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1127/2239] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:25.518621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.519140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.519434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.542620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:25.543914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:25.552184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1113/2240] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:25.556550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.566259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960299c-c91d-4373-9ea9-a960a20b6455 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.571713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.572325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.572594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.572872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.573523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:25.573829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.575516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.587853 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1128/2241] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:25.592101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.601411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6f7b4b-01ff-4dc5-8df4-40eaf2d47127 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.606072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.606673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.607001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.607275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.607903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.609779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.637775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1114/2242] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:25 2022] POST /identity/v3/projects => generated 389 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:25.642107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.653861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d22cde-7b08-4907-a37e-928648d83f56 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.712503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.713113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.713400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.713676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.714299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.716359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.737175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1129/2243] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:25 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:25.741233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.752421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a37cda-3558-467a-86dc-f56ad6d49e7f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.756979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.757568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.757882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.758392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.759083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.760659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.770997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1115/2244] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:25.775314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.785286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c06f32b-a00f-4278-bfd7-5ac72b4a6df7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.791004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872ff72f-2afb-4b75-90ff-29dfc65a1160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.791704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff72f-2afb-4b75-90ff-29dfc65a1160 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.792096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff72f-2afb-4b75-90ff-29dfc65a1160 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.792521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872ff72f-2afb-4b75-90ff-29dfc65a1160 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.793349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ff72f-2afb-4b75-90ff-29dfc65a1160 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.795255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872ff72f-2afb-4b75-90ff-29dfc65a1160 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.807304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1130/2245] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:25.811312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:25.822027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39419ce-c59c-4e7b-b4a0-3f193087358b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:25.828350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:25.829141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.829422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.829778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] PATH_INFO: `/v3/projects/4e396350c2c741c3bcc76c6e8c9cb423/users/3211eb7410ea43b590cac1a804ec9fde/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.845956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e396350c2c741c3bcc76c6e8c9cb423, user_id=3211eb7410ea43b590cac1a804ec9fde, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:25.848697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:25.864630 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1116/2246] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:25 2022] PUT /identity/v3/projects/4e396350c2c741c3bcc76c6e8c9cb423/users/3211eb7410ea43b590cac1a804ec9fde/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:25.877637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:25.878042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:25.878452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:25.907192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] MFA Rules not processed for user `3211eb7410ea43b590cac1a804ec9fde`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:25.908393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:25.981688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1131/2247] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:25 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:25.986145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.047593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e444bb94-2ea9-4a0e-8c01-8eb24bfe78f2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.052233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.052839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.053117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.053389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.054026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.056257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.082047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1117/2248] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:25 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:26.086565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.093413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:26.097926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c01cb48-845e-48b0-b501-45875199a30a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.159263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.160064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.160361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.160642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.161612 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.164539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.191433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1132/2249] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:26 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:26.192684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.200149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:26.204267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e971acd0-3e69-4927-b95a-61622bf52f8d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.210184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.211438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.212187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.212574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.213386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.218499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.233827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1118/2250] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:28:26.235792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.246464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbae5c-abc1-4139-a578-896602709d06 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.251683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.252469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.252904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.253243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] PATH_INFO: `/v3/projects/5e26eee770b040798fd35b5ba3289389/users/a878315a0c2a47118f02e643e5f13213/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.271047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e26eee770b040798fd35b5ba3289389, user_id=a878315a0c2a47118f02e643e5f13213, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.274816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.290105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1133/2251] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:26 2022] PUT /identity/v3/projects/5e26eee770b040798fd35b5ba3289389/users/a878315a0c2a47118f02e643e5f13213/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:26.294088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.305280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4985a-b489-481d-ad33-19f06c76ee82 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.366306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b97bfd9-d7c1-4490-a557-079d27bd01d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.367006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97bfd9-d7c1-4490-a557-079d27bd01d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.367483 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97bfd9-d7c1-4490-a557-079d27bd01d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.367782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b97bfd9-d7c1-4490-a557-079d27bd01d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.368440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97bfd9-d7c1-4490-a557-079d27bd01d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.370049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b97bfd9-d7c1-4490-a557-079d27bd01d7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.380931 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1119/2252] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:26 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:26.385844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.397145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c325154-835f-4aac-9062-b455dd3ed207 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.403226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.404234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.404531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.404818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] PATH_INFO: `/v3/projects/5e26eee770b040798fd35b5ba3289389/users/a878315a0c2a47118f02e643e5f13213/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.407081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e26eee770b040798fd35b5ba3289389, user_id=a878315a0c2a47118f02e643e5f13213, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.410240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.421861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1134/2253] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:26 2022] PUT /identity/v3/projects/5e26eee770b040798fd35b5ba3289389/users/a878315a0c2a47118f02e643e5f13213/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:26.433090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.433379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.433659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.463545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] MFA Rules not processed for user `a878315a0c2a47118f02e643e5f13213`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:26.464437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:26.537843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1120/2254] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:26 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:26.548476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.550192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:26.612372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f38bd3-5d78-4e0d-bfce-6aa8a445d137 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.616006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a74bf4-f9db-4986-9327-5c68a164473a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.616623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a74bf4-f9db-4986-9327-5c68a164473a service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.616909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a74bf4-f9db-4986-9327-5c68a164473a service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.617222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a74bf4-f9db-4986-9327-5c68a164473a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.626731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a74bf4-f9db-4986-9327-5c68a164473a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.630799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a74bf4-f9db-4986-9327-5c68a164473a service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.639847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1135/2255] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:26 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:26.784168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:26.850470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578de3d4-dae4-4a64-83f0-6961e3dd8c9c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:26.855620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:26.856276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.856611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.856884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] PATH_INFO: `/v3/users/3211eb7410ea43b590cac1a804ec9fde` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:26.858124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3211eb7410ea43b590cac1a804ec9fde)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:26.860304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:26.877869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:26.948548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3211eb7410ea43b590cac1a804ec9fde'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:26.961389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3211eb7410ea43b590cac1a804ec9fde'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:26.969385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3211eb7410ea43b590cac1a804ec9fde'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:26.970056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3211eb7410ea43b590cac1a804ec9fde'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:26.977560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3211eb7410ea43b590cac1a804ec9fde'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:26.991608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1121/2256] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:26 2022] DELETE /identity/v3/users/3211eb7410ea43b590cac1a804ec9fde => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:26.996994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:26.997652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:26.997943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:27.020211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:27.021428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:27.073730 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:27.083009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1136/2257] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:27.092922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:27.094366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:27.153581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64206bc0-cdf3-4580-bb34-9294c5ffe894 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:27.159530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:27.160171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:27.160456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:27.160736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:27.173472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:27.175548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:27.187026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1122/2258] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:27.484136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:27.485582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:27.497786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799550ac-54dc-4ed5-9943-89f854e2e37c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:27.503754 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:27.504540 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:27.504762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:27.505038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] PATH_INFO: `/v3/projects/4e396350c2c741c3bcc76c6e8c9cb423` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:27.506367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e396350c2c741c3bcc76c6e8c9cb423)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:27.509109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:27.570268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e396350c2c741c3bcc76c6e8c9cb423', 'request_id': 'req-c4bea85c-8ce9-4066-807e-0313cf584acf'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.576183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e396350c2c741c3bcc76c6e8c9cb423', 'request_id': 'req-c4bea85c-8ce9-4066-807e-0313cf584acf'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.584603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e396350c2c741c3bcc76c6e8c9cb423', 'request_id': 'req-c4bea85c-8ce9-4066-807e-0313cf584acf'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.597287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] The token cache is being invalidate because project 4e396350c2c741c3bcc76c6e8c9cb423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:27.597580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.598274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.599772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1137/2259] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:27 2022] DELETE /identity/v3/projects/4e396350c2c741c3bcc76c6e8c9cb423 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:27.604714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:27.615110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487259e8-541e-4da8-9a54-c54e4098a7c6 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:27.679622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:27.680606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:27.680902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:27.681164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] PATH_INFO: `/v3/users/a878315a0c2a47118f02e643e5f13213` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:27.682486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a878315a0c2a47118f02e643e5f13213)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:27.684390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:27.727550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:27.734295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a878315a0c2a47118f02e643e5f13213'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.761911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a878315a0c2a47118f02e643e5f13213'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.769443 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a878315a0c2a47118f02e643e5f13213'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.770188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a878315a0c2a47118f02e643e5f13213'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.778537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-009a3dac-5dcb-4af5-b7ca-c4498ab8725a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a878315a0c2a47118f02e643e5f13213'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:27.784354 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1123/2260] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:27 2022] DELETE /identity/v3/users/a878315a0c2a47118f02e643e5f13213 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:28.087323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.089216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:28.128407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bea85c-8ce9-4066-807e-0313cf584acf admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.199457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.200123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.200408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.200663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] PATH_INFO: `/v3/projects/5e26eee770b040798fd35b5ba3289389` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.201790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e26eee770b040798fd35b5ba3289389)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.203882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.253209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e26eee770b040798fd35b5ba3289389', 'request_id': 'req-461710ba-208c-4ac9-8c41-d9c8f179571e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:28.259978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e26eee770b040798fd35b5ba3289389', 'request_id': 'req-461710ba-208c-4ac9-8c41-d9c8f179571e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:28.268033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e26eee770b040798fd35b5ba3289389', 'request_id': 'req-461710ba-208c-4ac9-8c41-d9c8f179571e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:28.280140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] The token cache is being invalidate because project 5e26eee770b040798fd35b5ba3289389 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:28.280440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:28.281119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-461710ba-208c-4ac9-8c41-d9c8f179571e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:28.282683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1138/2261] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:28 2022] DELETE /identity/v3/projects/5e26eee770b040798fd35b5ba3289389 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:28.290809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.290809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.290809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.314734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:28.316037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:28.394289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1124/2262] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:28.403046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.403333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.403609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.423992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:28.425298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:28.434603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1139/2263] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:28.438900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.449861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126e8290-8b5a-4c15-a52c-2bf54d7bb77c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.454560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.455200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.455500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.455772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.456427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:28.456731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.458367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.470542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1125/2264] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:28.476197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.485685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92a1e49-19bc-48e8-acae-a09f8cf0e797 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.491092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.491597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.491881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.492883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.493586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.495557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.500173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:28.526485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1140/2265] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:28 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:28.530956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.544465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c19dce-4081-4e64-a56a-4b4558d603f7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.605974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.606806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.607089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.607362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.608000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.609958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.633234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1126/2266] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:28 2022] POST /identity/v3/users => generated 293 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:28.637342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.647734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8530b5e6-2cb9-4efe-bb74-ba36e5ade51f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.653880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.654690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.655010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.655403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.655970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.657600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.668226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1141/2267] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:28.672069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.683963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1718dac1-9f18-40cb-a836-8d54395901fb admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.688601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643ee866-595a-464d-ab6f-686de0b1269f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.689225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee866-595a-464d-ab6f-686de0b1269f admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.689507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee866-595a-464d-ab6f-686de0b1269f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.689780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643ee866-595a-464d-ab6f-686de0b1269f admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.690426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ee866-595a-464d-ab6f-686de0b1269f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.692049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643ee866-595a-464d-ab6f-686de0b1269f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.703008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1127/2268] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:28.706830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.717945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db84e8fa-99f0-4d31-b7f1-fe5b63dad620 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:28.723672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:28.724371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.724660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.724944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] PATH_INFO: `/v3/projects/16c50a1f33d849ab95cdcd08f96eff26/users/b2f588e98cb44492a5bafa35adffcc1d/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.741275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=16c50a1f33d849ab95cdcd08f96eff26, user_id=b2f588e98cb44492a5bafa35adffcc1d, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:28.744794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:28.760542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1142/2269] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:28 2022] PUT /identity/v3/projects/16c50a1f33d849ab95cdcd08f96eff26/users/b2f588e98cb44492a5bafa35adffcc1d/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:28.827505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:28.827795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:28.828070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:28.857272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] MFA Rules not processed for user `b2f588e98cb44492a5bafa35adffcc1d`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:28.858498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:28.868596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:28.937750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1128/2270] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:28 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:28.947039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:28.948471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:29.005588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d1f83-a2a5-4d63-a589-bdf0023acca2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:29.010080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6a99db-b073-4b54-872a-66fb5ef48373 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:29.010692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a99db-b073-4b54-872a-66fb5ef48373 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:29.011005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a99db-b073-4b54-872a-66fb5ef48373 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:29.011279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6a99db-b073-4b54-872a-66fb5ef48373 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:29.019919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a99db-b073-4b54-872a-66fb5ef48373 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:29.021333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6a99db-b073-4b54-872a-66fb5ef48373 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:29.031129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1143/2271] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:29.053669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:29.128629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ee93de-9e89-41a2-ab64-e675de3253cc None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:29.133705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:29.134333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:29.134615 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:29.135063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] PATH_INFO: `/v3/users/b2f588e98cb44492a5bafa35adffcc1d` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:29.136208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2f588e98cb44492a5bafa35adffcc1d)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:29.138120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:29.186498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2f588e98cb44492a5bafa35adffcc1d'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.199750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2f588e98cb44492a5bafa35adffcc1d'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.207533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2f588e98cb44492a5bafa35adffcc1d'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.208292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2f588e98cb44492a5bafa35adffcc1d'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.217735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2f588e98cb44492a5bafa35adffcc1d'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.224051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1129/2272] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:29 2022] DELETE /identity/v3/users/b2f588e98cb44492a5bafa35adffcc1d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:29.229510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:29.229998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:29.230076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:29.249432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:29.250778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:29.344165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1144/2273] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:29.356389 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:29.358916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:29.398579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:29.445144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87533558-547e-4d6f-89dd-7924dd0f322c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:29.457664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:29.458688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:29.459009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:29.459292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:29.470494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:29.472019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:29.496621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1130/2274] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:29.804099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:29.806019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:29.823289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e593a-075e-4aed-ac8b-5907f464724c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:29.829792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:29.830840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:29.831184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:29.831975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] PATH_INFO: `/v3/projects/16c50a1f33d849ab95cdcd08f96eff26` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:29.833351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16c50a1f33d849ab95cdcd08f96eff26)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:29.835273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:29.883710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:29.885023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16c50a1f33d849ab95cdcd08f96eff26', 'request_id': 'req-4cc997c9-532d-4bd0-96a2-52aca3082d28'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.891983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16c50a1f33d849ab95cdcd08f96eff26', 'request_id': 'req-4cc997c9-532d-4bd0-96a2-52aca3082d28'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.900999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16c50a1f33d849ab95cdcd08f96eff26', 'request_id': 'req-4cc997c9-532d-4bd0-96a2-52aca3082d28'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.912812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] The token cache is being invalidate because project 16c50a1f33d849ab95cdcd08f96eff26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:29.913099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.913743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-4cc997c9-532d-4bd0-96a2-52aca3082d28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:29.915951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1145/2275] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:29 2022] DELETE /identity/v3/projects/16c50a1f33d849ab95cdcd08f96eff26 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:33.303968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:33.305388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:33.318716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e988321-0a33-48f5-8d3e-7ec04fa23127 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:33.376958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:33.377601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:33.377886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:33.378162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] PATH_INFO: `/v3/users/d7161ec7e27c40c7adbc63ea7d7cbd50` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:33.379307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7161ec7e27c40c7adbc63ea7d7cbd50)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:33.381310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:33.426827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7161ec7e27c40c7adbc63ea7d7cbd50'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:33.438963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7161ec7e27c40c7adbc63ea7d7cbd50'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:33.446065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7161ec7e27c40c7adbc63ea7d7cbd50'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:33.446660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7161ec7e27c40c7adbc63ea7d7cbd50'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:33.454317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7161ec7e27c40c7adbc63ea7d7cbd50'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:33.461173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1131/2276] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:33 2022] DELETE /identity/v3/users/d7161ec7e27c40c7adbc63ea7d7cbd50 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:33.466323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:33.466866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:33.466976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:33.494639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:33.496437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:33.560756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1146/2277] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:33.570463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:33.571957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:33.635226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6475eb4d-b5a0-4252-a929-e68ae87dd2d4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:33.639149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f097fb-9c07-4bb2-85a5-06141dc4f60d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:33.639765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f097fb-9c07-4bb2-85a5-06141dc4f60d service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:33.642474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f097fb-9c07-4bb2-85a5-06141dc4f60d service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:33.642805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f097fb-9c07-4bb2-85a5-06141dc4f60d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:33.650391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:33.654179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f097fb-9c07-4bb2-85a5-06141dc4f60d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:33.656060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f097fb-9c07-4bb2-85a5-06141dc4f60d service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:33.668864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1132/2278] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:34.053580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.055653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:34.075594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2e88d6-8a37-43f4-9bc5-30ab9c396349 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.081850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.082591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.082972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.083419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] PATH_INFO: `/v3/projects/62c4614b8d96471d9ffea70923f2d721` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.084780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62c4614b8d96471d9ffea70923f2d721)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.086939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.151096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62c4614b8d96471d9ffea70923f2d721', 'request_id': 'req-efbd64ca-f397-4216-b67e-6bc45558aa98'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:34.159604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62c4614b8d96471d9ffea70923f2d721', 'request_id': 'req-efbd64ca-f397-4216-b67e-6bc45558aa98'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:34.170726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62c4614b8d96471d9ffea70923f2d721', 'request_id': 'req-efbd64ca-f397-4216-b67e-6bc45558aa98'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:34.186022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] The token cache is being invalidate because project 62c4614b8d96471d9ffea70923f2d721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:34.186301 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:34.186994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-efbd64ca-f397-4216-b67e-6bc45558aa98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:34.188508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1147/2279] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:34 2022] DELETE /identity/v3/projects/62c4614b8d96471d9ffea70923f2d721 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:34.193459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.193743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.194012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.217297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:34.218527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:34.297220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1133/2280] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:34.304374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.304661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.304964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.335472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:34.337007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:34.351552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1148/2281] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:34.357980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.375732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574457ca-fe2d-41d8-ba5d-d16cae7f1806 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.380794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.381408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.381696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.381967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.382635 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:34.382966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.384665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.399786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1134/2282] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:34.405205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.416267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905ba356-bbe7-4602-97a9-10d5e7592b65 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.422528 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.423179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.423464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.423785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.424483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.427179 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.460445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1149/2283] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:34 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:28:34.466420 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.476709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6324350-18a7-4a12-97c3-07e360fd6e1b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.537109 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.537745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.538030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.538299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.539002 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.541628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.568610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1135/2284] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:34 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:34.573087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.592693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79304c8f-6681-4688-88dd-3e83e1c5e0a5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.601644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.602424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.602779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.603239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.604004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.605891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.744906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1150/2285] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:34.749512 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.761997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2193fd37-3339-46c7-8d58-f9d27863f3ec admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.767353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7f1b6-7c3d-4de3-a59a-02bac47de151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.768542 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7f1b6-7c3d-4de3-a59a-02bac47de151 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.769014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7f1b6-7c3d-4de3-a59a-02bac47de151 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.769473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7f1b6-7c3d-4de3-a59a-02bac47de151 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.770210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7f1b6-7c3d-4de3-a59a-02bac47de151 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.771862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7f1b6-7c3d-4de3-a59a-02bac47de151 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.786947 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1136/2286] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:34 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:34.792924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:34.807318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f4bca-b6da-4017-a6c2-d42199fb9138 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:34.814321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:34.814849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.815132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.815396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] PATH_INFO: `/v3/projects/390730ac969941e382aa2031f7416e65/users/277acb93cc1547228bf8bb97487d5d2e/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.843594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=390730ac969941e382aa2031f7416e65, user_id=277acb93cc1547228bf8bb97487d5d2e, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:34.849715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:34.856228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:34.878330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1151/2287] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:34 2022] PUT /identity/v3/projects/390730ac969941e382aa2031f7416e65/users/277acb93cc1547228bf8bb97487d5d2e/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:34.898837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:34.898837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:34.898837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:34.932272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] MFA Rules not processed for user `277acb93cc1547228bf8bb97487d5d2e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:34.934010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:34.982281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:35.000723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1137/2288] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:41.004098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:41.005838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:41.063762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b914fbb-ab4b-41e7-aa1a-1e442b124bbb admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:41.067232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060f626f-70c8-4b46-a137-2cc901fd83f8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:41.067840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f626f-70c8-4b46-a137-2cc901fd83f8 service glance] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:41.068123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f626f-70c8-4b46-a137-2cc901fd83f8 service glance] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:41.068390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060f626f-70c8-4b46-a137-2cc901fd83f8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:41.078748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f626f-70c8-4b46-a137-2cc901fd83f8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:41.079545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060f626f-70c8-4b46-a137-2cc901fd83f8 service glance] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:41.089580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1152/2289] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:44.997655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:51.084960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=28 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:51.697896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:51.702462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:51.772196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3f91cf-248d-4086-9cc2-ce0f0c18bc3b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:51.777317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:51.778062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:51.778633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:51.779075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] PATH_INFO: `/v3/users/ca1c1b1fb2d048a6b6c53077dbae2c6e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:51.780286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca1c1b1fb2d048a6b6c53077dbae2c6e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:51.783474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:51.858546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca1c1b1fb2d048a6b6c53077dbae2c6e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:51.873265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca1c1b1fb2d048a6b6c53077dbae2c6e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:51.884159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca1c1b1fb2d048a6b6c53077dbae2c6e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:51.884861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca1c1b1fb2d048a6b6c53077dbae2c6e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:51.892704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca1c1b1fb2d048a6b6c53077dbae2c6e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:51.899895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1138/2290] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:51 2022] DELETE /identity/v3/users/ca1c1b1fb2d048a6b6c53077dbae2c6e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:51.904632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:51.904919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:51.905197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:51.929847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:51.930980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:52.008865 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1153/2291] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:52.015716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:52.017423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:52.113643 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5301c-b1fa-4f64-a5e0-963a27b0bca9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:52.117700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f67f2-8309-4973-b45a-6544e9b981d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:52.118329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f67f2-8309-4973-b45a-6544e9b981d7 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:52.118611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f67f2-8309-4973-b45a-6544e9b981d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:52.118914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f67f2-8309-4973-b45a-6544e9b981d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:52.137031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f67f2-8309-4973-b45a-6544e9b981d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:52.139555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f67f2-8309-4973-b45a-6544e9b981d7 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:52.160440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1139/2292] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:52.774826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:52.776345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:52.791618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952cafb-8172-4100-a0a2-5dfa89454bdd None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:52.798345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:52.799151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:52.799436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:52.800156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] PATH_INFO: `/v3/projects/69e1934b48824d8fbe555757c94d22a2` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:52.802091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e1934b48824d8fbe555757c94d22a2)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:52.804735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:52.866416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e1934b48824d8fbe555757c94d22a2', 'request_id': 'req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:52.872017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e1934b48824d8fbe555757c94d22a2', 'request_id': 'req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:52.881707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e1934b48824d8fbe555757c94d22a2', 'request_id': 'req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:52.898141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] The token cache is being invalidate because project 69e1934b48824d8fbe555757c94d22a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:52.898436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:52.900025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f5a0aa68-1f2d-4eb2-a527-3df0e9b4b4f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:52.909637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1154/2293] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:52 2022] DELETE /identity/v3/projects/69e1934b48824d8fbe555757c94d22a2 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:52.910290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:52.910795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:52.910889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:52.943197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:52.944515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:52.969192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:53.022089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1140/2294] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:53.031003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.031003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.031215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.051044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:53.052247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:53.060253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1155/2295] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:53.064477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.074348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aa20ee-24d2-40b7-b5b3-47459f4f87fa None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.079376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.079979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.080256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.080558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.081206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:53.081509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.083139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.095978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1141/2296] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:53.100280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.110598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb857cc6-c4da-4d97-8ee4-a50744a405bc None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.115314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.115910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.116186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.116460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.117088 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.119076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.156235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1156/2297] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:53 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:53.158090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.168682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7a9cb3-de87-4773-98c3-d8001e1f41f6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.233707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.234360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.235086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.235086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.235623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.238014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.265588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1142/2298] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:53 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:53.269944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.281747 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dbc205-ae34-4a19-9891-eb0e3a09e609 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.308754 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.314270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.314572 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.314879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.315599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.317237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.328790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1157/2299] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:53.333107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.344124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ac13a-0b6a-4002-9fec-35dbc82e59cd admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.349365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb889d7c-05de-489e-89ff-0e487af31658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.350175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb889d7c-05de-489e-89ff-0e487af31658 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.350458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb889d7c-05de-489e-89ff-0e487af31658 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.350994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb889d7c-05de-489e-89ff-0e487af31658 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.351729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb889d7c-05de-489e-89ff-0e487af31658 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.354751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb889d7c-05de-489e-89ff-0e487af31658 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.374737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1143/2300] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:28:53.380487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.393322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34160c-3745-4bf8-bf48-a64dbb94c361 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.398100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.398788 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.399077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.399357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] PATH_INFO: `/v3/projects/6ac566af8c3f45b7a4156b4f7f8ccf2a/users/f7542b5438cd423e96fe55e2dc3d5614/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.414417 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ac566af8c3f45b7a4156b4f7f8ccf2a, user_id=f7542b5438cd423e96fe55e2dc3d5614, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.417090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.435573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1158/2301] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:53 2022] PUT /identity/v3/projects/6ac566af8c3f45b7a4156b4f7f8ccf2a/users/f7542b5438cd423e96fe55e2dc3d5614/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:53.445841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.446154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.446454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.475969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] MFA Rules not processed for user `f7542b5438cd423e96fe55e2dc3d5614`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:53.477244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:53.553748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1144/2302] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:53.564769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:53.566679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:53.589230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:53.632098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8d77bd-a2b2-4f98-9077-b223c2d7e762 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:53.636058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e95ce19-5c48-4c30-a58a-e547292d1877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:53.636780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ce19-5c48-4c30-a58a-e547292d1877 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:53.637064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ce19-5c48-4c30-a58a-e547292d1877 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:53.637369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e95ce19-5c48-4c30-a58a-e547292d1877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:53.647039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95ce19-5c48-4c30-a58a-e547292d1877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:53.648476 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e95ce19-5c48-4c30-a58a-e547292d1877 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:53.660750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1159/2303] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:56.845777 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:56.873522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:56.932412 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8110e900-4a5b-430d-8ba5-7e6753eb7302 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:56.938676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:56.939395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:56.939675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:56.939949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] PATH_INFO: `/v3/users/f7542b5438cd423e96fe55e2dc3d5614` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:56.941217 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7542b5438cd423e96fe55e2dc3d5614)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:56.947031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:57.036104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7542b5438cd423e96fe55e2dc3d5614'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.058070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7542b5438cd423e96fe55e2dc3d5614'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.068894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7542b5438cd423e96fe55e2dc3d5614'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.075822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7542b5438cd423e96fe55e2dc3d5614'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.084886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7542b5438cd423e96fe55e2dc3d5614'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.092394 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1145/2304] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:28:56 2022] DELETE /identity/v3/users/f7542b5438cd423e96fe55e2dc3d5614 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:57.097099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:57.097672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:57.097672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:57.118689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:57.119943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:57.201882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1160/2305] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:57.208518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:57.211346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:57.296620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3303c0-4f9d-4cc6-b2b0-a841606f07ca admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:57.306295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb5b1ff-15b2-4d42-8a82-63d9f0bf1288 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:57.306977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5b1ff-15b2-4d42-8a82-63d9f0bf1288 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:57.310836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5b1ff-15b2-4d42-8a82-63d9f0bf1288 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:57.312193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb5b1ff-15b2-4d42-8a82-63d9f0bf1288 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:57.332132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5b1ff-15b2-4d42-8a82-63d9f0bf1288 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:57.334087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb5b1ff-15b2-4d42-8a82-63d9f0bf1288 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:57.346132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1146/2306] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:28:57.861276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:57.862729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:57.876307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df307a1-6f47-4acb-987e-902482ed6669 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:57.881101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:57.881744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:57.882024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:57.882515 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] PATH_INFO: `/v3/projects/6ac566af8c3f45b7a4156b4f7f8ccf2a` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:57.883699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ac566af8c3f45b7a4156b4f7f8ccf2a)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:57.885779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:57.938405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ac566af8c3f45b7a4156b4f7f8ccf2a', 'request_id': 'req-d573398b-46f3-4dfa-af95-ec0a0cbf9501'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.943908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ac566af8c3f45b7a4156b4f7f8ccf2a', 'request_id': 'req-d573398b-46f3-4dfa-af95-ec0a0cbf9501'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.953023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ac566af8c3f45b7a4156b4f7f8ccf2a', 'request_id': 'req-d573398b-46f3-4dfa-af95-ec0a0cbf9501'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.964501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] The token cache is being invalidate because project 6ac566af8c3f45b7a4156b4f7f8ccf2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:28:57.964847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.966071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d573398b-46f3-4dfa-af95-ec0a0cbf9501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:28:57.967748 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1161/2307] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:28:57 2022] DELETE /identity/v3/projects/6ac566af8c3f45b7a4156b4f7f8ccf2a => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:57.972726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:57.973224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:57.973437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:57.993040 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:57.994285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:58.035049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:58.058803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1147/2308] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:58.068193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.068489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.068768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.089414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:58.090923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:58.099300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1162/2309] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:58.103866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.115553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654bbab-5dfa-4d47-835f-21500f759863 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.125965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.126588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.126929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.127172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.127957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:28:58.128199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.130240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.152019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1148/2310] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:28:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:28:58.157226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.166637 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a37ee9-74e0-481d-9e51-8d42155b0c18 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.172891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.173538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.173862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.174368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.174909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.176851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.208861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1163/2311] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:58 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:58.213135 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.224627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae2524b-961a-4aa5-8b80-0997b17f6fe9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.297541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.298230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.298553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.298874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.299739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.302215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.327116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1149/2312] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:58 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:58.331261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.342163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb077517-98e4-4ecd-98f0-d5245294dbf8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.355403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.356633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.357118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.357364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.358018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.359659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.370939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1164/2313] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:58.375186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.385611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b311c8b2-60cf-4935-8db1-07ed0f964b73 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.391248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ccd02f-096c-4170-b31d-196151c3430b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.391866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd02f-096c-4170-b31d-196151c3430b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.392149 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd02f-096c-4170-b31d-196151c3430b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.392425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ccd02f-096c-4170-b31d-196151c3430b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.393085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccd02f-096c-4170-b31d-196151c3430b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.394695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ccd02f-096c-4170-b31d-196151c3430b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.408046 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1150/2314] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:58.416407 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.428986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193ca7f7-42f4-4562-9e43-dbde11864ccd admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.438240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.438861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.439101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.439383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] PATH_INFO: `/v3/projects/b70c6fdfaaf34b9680c7e9923299c540/users/206bca74801c4a79807be00f464f8e0f/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.442438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:58.467073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70c6fdfaaf34b9680c7e9923299c540, user_id=206bca74801c4a79807be00f464f8e0f, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.471230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.510433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1165/2315] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:58 2022] PUT /identity/v3/projects/b70c6fdfaaf34b9680c7e9923299c540/users/206bca74801c4a79807be00f464f8e0f/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:58.512250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.512638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.512923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.553489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] MFA Rules not processed for user `206bca74801c4a79807be00f464f8e0f`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:58.555305 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:58.642678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1151/2316] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:58 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:58.647558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.750168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951193ef-655f-49b4-8b06-e32c553715e2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.754893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.755494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.755772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.756044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.756744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.758957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.787857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1166/2317] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:58 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:58.792038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.809444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519b5369-9561-4b95-80b2-30c6ec1d69eb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.846248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:58.882246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.882839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.883147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.883441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.884210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.887196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.926661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1152/2318] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:58 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:28:58.928620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.945486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30490bdb-2c5f-4efb-9f44-c05390f74ab9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:58.956725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:58.958234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:58.959112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:58.960119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:58.961307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:58.963875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:58.983565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1167/2319] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:58.984862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:58.997095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bd0a03-e56b-40e6-bc93-0eaada5edc7a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.006779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed95746-85be-475b-b27d-a02bd432da0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.008574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed95746-85be-475b-b27d-a02bd432da0b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.009820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed95746-85be-475b-b27d-a02bd432da0b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.010404 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed95746-85be-475b-b27d-a02bd432da0b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.011367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed95746-85be-475b-b27d-a02bd432da0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.016317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed95746-85be-475b-b27d-a02bd432da0b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.038092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1153/2320] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:58 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:59.038825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.065451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f91d7bb-a4c1-4342-b6da-ac737bbbba58 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.070923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.071709 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.072059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.072382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] PATH_INFO: `/v3/projects/d3063fe7134b410c9aa3c007108eda74/users/222c1d12d6704f9a81d673edef2cf241/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.094686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3063fe7134b410c9aa3c007108eda74, user_id=222c1d12d6704f9a81d673edef2cf241, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.098513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.124920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1168/2321] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:59 2022] PUT /identity/v3/projects/d3063fe7134b410c9aa3c007108eda74/users/222c1d12d6704f9a81d673edef2cf241/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:59.135602 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.135846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.136116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.165416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] MFA Rules not processed for user `222c1d12d6704f9a81d673edef2cf241`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:59.166638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:59.234091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1154/2322] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:28:59.238371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.303609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e4b62-8ec9-45ff-862a-673f89ea67a5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.308386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.309665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.310144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.310556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.311207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.313101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.344006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1169/2323] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:28:59 2022] POST /identity/v3/projects => generated 375 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:59.345491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.356984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c7235c-ed77-4cf3-932c-9fdc2b336fd9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.417059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.417707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.417987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.418325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.419072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.421352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.444021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1155/2324] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:28:59 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:28:59.448194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.461108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26127f06-93f2-4833-9111-813ea3a5bc31 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.466625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.467283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.467630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.467968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.469161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.471244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.487436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1170/2325] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:59.488632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.500250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ff0c5f-76f6-4e4d-ac9d-6dc53c4176b6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.505059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.505725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.506010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.506289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] PATH_INFO: `/v3/projects/1e2bb36739db4f4983554b96de8070da/users/bb7891dc8b2a4083b5a26375b91f1624/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.524098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2bb36739db4f4983554b96de8070da, user_id=bb7891dc8b2a4083b5a26375b91f1624, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.527884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.542024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1156/2326] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:59 2022] PUT /identity/v3/projects/1e2bb36739db4f4983554b96de8070da/users/bb7891dc8b2a4083b5a26375b91f1624/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:28:59.547054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.556814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a9c913-6690-4591-bf8e-18b7a4081305 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.560938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:59.626518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41457613-f841-4bd8-99f6-1442bfb7a642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.627449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457613-f841-4bd8-99f6-1442bfb7a642 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.627909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457613-f841-4bd8-99f6-1442bfb7a642 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.628276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41457613-f841-4bd8-99f6-1442bfb7a642 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.629026 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41457613-f841-4bd8-99f6-1442bfb7a642 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.630943 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41457613-f841-4bd8-99f6-1442bfb7a642 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.642346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1171/2327] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:28:59 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:28:59.646457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.660342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214a48a7-a2c3-40bc-8bf4-d88dcc7ba47e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.665361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.666585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.666903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.667245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] PATH_INFO: `/v3/projects/1e2bb36739db4f4983554b96de8070da/users/bb7891dc8b2a4083b5a26375b91f1624/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.669401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e2bb36739db4f4983554b96de8070da, user_id=bb7891dc8b2a4083b5a26375b91f1624, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.672198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:28:59.675851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:28:59.693633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1157/2328] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:28:59 2022] PUT /identity/v3/projects/1e2bb36739db4f4983554b96de8070da/users/bb7891dc8b2a4083b5a26375b91f1624/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:28:59.706844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c35f7-7ee1-42c5-8be6-7a1ddd2611c6 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.707204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c35f7-7ee1-42c5-8be6-7a1ddd2611c6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.707547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c35f7-7ee1-42c5-8be6-7a1ddd2611c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.740597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-092c35f7-7ee1-42c5-8be6-7a1ddd2611c6 None None] MFA Rules not processed for user `bb7891dc8b2a4083b5a26375b91f1624`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:28:59.742049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-092c35f7-7ee1-42c5-8be6-7a1ddd2611c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:59.823236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1172/2329] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:28:59.835089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:28:59.836821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:28:59.897216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9420aa18-c503-4393-a6f4-d498da73b6c2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:28:59.901595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:28:59.902246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.902528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.903558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.971932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6474823-3e74-4c24-840f-afca73580b0d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:28:59.972220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6474823-3e74-4c24-840f-afca73580b0d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:28:59.972568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6474823-3e74-4c24-840f-afca73580b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:28:59.992265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:28:59.993735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:00.000399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e6474823-3e74-4c24-840f-afca73580b0d None None] MFA Rules not processed for user `8c10c73d9ffa4f849c45e77926c0b0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:00.001599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e6474823-3e74-4c24-840f-afca73580b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:00.015345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1158/2330] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:28:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:00.084507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1173/2331] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:28:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:29:00.249357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:00.251035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:00.412095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817a2ac-899c-4ffc-86fa-fb5621380649 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:00.421081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:00.421971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:00.423399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:00.424342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:00.432062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:00.572254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:00.574031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:00.583107 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:00.589829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1159/2332] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:00 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:01.344600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:01.345190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:01.345190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:01.375838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:01.377984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:01.448419 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:01.532842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1174/2333] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:29:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:01.589897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:01.592895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:01.713814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb9268f-e77e-4b2e-a0e2-51e001e2ad5f service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:01.720509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:01.721458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:01.721916 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:01.722337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:01.736619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:01.738757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:01.772147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1160/2334] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:29:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:29:01.839726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:01.841641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:01.855768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a017f4-e64e-40bc-9d03-44569895eae0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:01.860875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920bfa0-e654-436a-ae17-151bb5c1c75f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:01.861933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bfa0-e654-436a-ae17-151bb5c1c75f service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:01.862443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bfa0-e654-436a-ae17-151bb5c1c75f service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:01.862978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920bfa0-e654-436a-ae17-151bb5c1c75f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:01.944281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:01.945741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:01.979511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bfa0-e654-436a-ae17-151bb5c1c75f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:01.986948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9920bfa0-e654-436a-ae17-151bb5c1c75f service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:02.011862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1175/2335] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:02.105435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfee451a-4134-477e-9d41-b080fcb56227 service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:02.129016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:02.129764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:02.130049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:02.130333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] PATH_INFO: `/v3/users/d4830a171c8f48ecb34dc29997889bc2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:02.132507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4830a171c8f48ecb34dc29997889bc2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:02.137847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:02.258672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4830a171c8f48ecb34dc29997889bc2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:02.308736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4830a171c8f48ecb34dc29997889bc2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:02.341211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4830a171c8f48ecb34dc29997889bc2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:02.342594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4830a171c8f48ecb34dc29997889bc2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:02.355087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4830a171c8f48ecb34dc29997889bc2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:02.380437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1161/2336] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:29:01 2022] DELETE /identity/v3/users/d4830a171c8f48ecb34dc29997889bc2 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:29:02.387812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:02.388282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:02.388479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:02.436011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:02.437620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:02.643392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1176/2337] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:02.655100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:02.657143 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:02.680500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:02.865044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103ae6ed-e276-4f68-8f41-227ad1087b4b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:02.884396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:02.884396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:02.884396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:02.884396 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:02.942480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:02.949345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:02.977951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1162/2338] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:03.198484 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:03.200031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:03.326140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3af2bd-a157-4841-b52a-f83f30139fc8 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:03.336025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:03.336591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:03.336876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:03.337148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:03.342811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:03.429924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:03.500009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:03.502166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:03.520478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1177/2339] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:03 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:04.308186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:04.310353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:04.329008 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bd0d91-ebe9-4461-aed4-9b9272c37ce2 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:04.361642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:04.364070 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:04.365025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:04.366494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] PATH_INFO: `/v3/projects/d953a1f42e354e77ac7eac713612a4c2` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:04.374344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d953a1f42e354e77ac7eac713612a4c2)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:04.380037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:04.592430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd953a1f42e354e77ac7eac713612a4c2', 'request_id': 'req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:04.601440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd953a1f42e354e77ac7eac713612a4c2', 'request_id': 'req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:04.613398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd953a1f42e354e77ac7eac713612a4c2', 'request_id': 'req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:04.629905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] The token cache is being invalidate because project d953a1f42e354e77ac7eac713612a4c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:29:04.630469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:04.631868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6b0920b2-adbf-41d1-b25f-1f6bd70984b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:04.637383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1163/2340] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:29:04 2022] DELETE /identity/v3/projects/d953a1f42e354e77ac7eac713612a4c2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:07.925992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:07.927350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:07.961525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c76cc35-8300-4245-9aee-685eb85584a0 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:08.062924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:08.063823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:08.064269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:08.064816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] PATH_INFO: `/v3/users/206bca74801c4a79807be00f464f8e0f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:08.066125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=206bca74801c4a79807be00f464f8e0f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:08.073190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:08.174209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '206bca74801c4a79807be00f464f8e0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:08.175409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '206bca74801c4a79807be00f464f8e0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:08.212839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '206bca74801c4a79807be00f464f8e0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:08.230083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '206bca74801c4a79807be00f464f8e0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:08.242956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '206bca74801c4a79807be00f464f8e0f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:08.249738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1178/2341] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:29:07 2022] DELETE /identity/v3/users/206bca74801c4a79807be00f464f8e0f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:08.255138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:08.255922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:08.256534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:08.280601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:08.284445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:08.406130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1164/2342] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:08.415977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:08.417834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:08.500700 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:08.514874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9b387-eb54-4cd6-b71c-9a26f643be8e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:08.523598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:08.524237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:08.524827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:08.525250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:08.545504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:08.547168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:08.561609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1179/2343] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:08.922045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:08.924456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:08.950561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294edd68-e15b-437e-9ebd-a8ba7083bbb3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:08.956399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:08.957158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:08.957511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:08.957849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] PATH_INFO: `/v3/projects/b70c6fdfaaf34b9680c7e9923299c540` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:08.959316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70c6fdfaaf34b9680c7e9923299c540)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:08.964256 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:09.013216 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:09.032438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70c6fdfaaf34b9680c7e9923299c540', 'request_id': 'req-d33ca31b-f3ed-4129-93db-614a08364e49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.048219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70c6fdfaaf34b9680c7e9923299c540', 'request_id': 'req-d33ca31b-f3ed-4129-93db-614a08364e49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.062430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70c6fdfaaf34b9680c7e9923299c540', 'request_id': 'req-d33ca31b-f3ed-4129-93db-614a08364e49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.079544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] The token cache is being invalidate because project b70c6fdfaaf34b9680c7e9923299c540 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:29:09.079827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.080477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.081971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1165/2344] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:29:08 2022] DELETE /identity/v3/projects/b70c6fdfaaf34b9680c7e9923299c540 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:29:09.086016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:09.098077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0de28e-8062-4dfd-9509-b5eae3b24696 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:09.168024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:09.168822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:09.169114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:09.169457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] PATH_INFO: `/v3/users/222c1d12d6704f9a81d673edef2cf241` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:09.170971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=222c1d12d6704f9a81d673edef2cf241)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:09.173096 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:09.237212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '222c1d12d6704f9a81d673edef2cf241'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.238779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '222c1d12d6704f9a81d673edef2cf241'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.259406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '222c1d12d6704f9a81d673edef2cf241'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.272366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '222c1d12d6704f9a81d673edef2cf241'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.282932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '222c1d12d6704f9a81d673edef2cf241'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.290402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1180/2345] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:29:09 2022] DELETE /identity/v3/users/222c1d12d6704f9a81d673edef2cf241 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:09.636223 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:09.644473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:09.672473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33ca31b-f3ed-4129-93db-614a08364e49 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:09.792130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:09.793744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:09.794411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:09.795035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] PATH_INFO: `/v3/projects/d3063fe7134b410c9aa3c007108eda74` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:09.796284 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3063fe7134b410c9aa3c007108eda74)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:09.798306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:09.871231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3063fe7134b410c9aa3c007108eda74', 'request_id': 'req-35424051-720e-4c82-82e4-751a1fda84e2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.890911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3063fe7134b410c9aa3c007108eda74', 'request_id': 'req-35424051-720e-4c82-82e4-751a1fda84e2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.895705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3063fe7134b410c9aa3c007108eda74', 'request_id': 'req-35424051-720e-4c82-82e4-751a1fda84e2'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.911380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] The token cache is being invalidate because project d3063fe7134b410c9aa3c007108eda74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:29:09.911997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.912849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:09.914818 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1166/2346] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:29:09 2022] DELETE /identity/v3/projects/d3063fe7134b410c9aa3c007108eda74 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:09.919174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:09.920804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:09.936984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07633428-1e9e-408c-98f1-5afadaa16b5b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:10.006287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:10.006965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:10.007252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:10.007529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] PATH_INFO: `/v3/users/bb7891dc8b2a4083b5a26375b91f1624` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:10.008674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7891dc8b2a4083b5a26375b91f1624)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:10.010641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:10.026539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:10.078999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7891dc8b2a4083b5a26375b91f1624'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.079681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7891dc8b2a4083b5a26375b91f1624'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.094437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7891dc8b2a4083b5a26375b91f1624'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.103986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7891dc8b2a4083b5a26375b91f1624'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.114382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-17ebeafc-7190-428e-88d9-702a0cfd58fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7891dc8b2a4083b5a26375b91f1624'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.125007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1181/2347] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:29:09 2022] DELETE /identity/v3/users/bb7891dc8b2a4083b5a26375b91f1624 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:10.524094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:10.525997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:10.551386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35424051-720e-4c82-82e4-751a1fda84e2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:10.706243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:10.743415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:10.743415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:10.743723 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:10.743866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] PATH_INFO: `/v3/projects/1e2bb36739db4f4983554b96de8070da` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:10.747553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e2bb36739db4f4983554b96de8070da)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:10.750816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:10.823963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e2bb36739db4f4983554b96de8070da', 'request_id': 'req-70fceb2a-7eee-41f5-a857-a6dcee31289e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.830598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e2bb36739db4f4983554b96de8070da', 'request_id': 'req-70fceb2a-7eee-41f5-a857-a6dcee31289e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.843605 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e2bb36739db4f4983554b96de8070da', 'request_id': 'req-70fceb2a-7eee-41f5-a857-a6dcee31289e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.865642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] The token cache is being invalidate because project 1e2bb36739db4f4983554b96de8070da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:29:10.865943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.866637 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-70fceb2a-7eee-41f5-a857-a6dcee31289e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:10.869470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1167/2348] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:29:10 2022] DELETE /identity/v3/projects/1e2bb36739db4f4983554b96de8070da => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:10.874357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:10.874649 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:10.874960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:10.899340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:10.901589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:10.978367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1182/2349] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:10.987960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:10.988237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:10.988513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.015965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:11.017245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:11.033804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1168/2350] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:29:11.038210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.051822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d468fb-92a1-403f-b5c9-92dc3e0ac2fd None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.057902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.058812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.059782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.060183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.060963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:29:11.061370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.063965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.081874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1183/2351] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:29:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:29:11.086747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.099236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c294d6-03f2-4d28-a75b-2a6502efcad6 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.105138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.106569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.107307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.107608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.108314 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.111110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.183500 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1169/2352] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:29:11 2022] POST /identity/v3/projects => generated 371 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:29:11.183770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.197020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7639d6-01da-4158-a2b6-2d6bc9179379 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.298428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.299242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.299662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.300039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.300787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.303040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.333399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1184/2353] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:29:11 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:29:11.337813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.349502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c2e69f-28da-4325-b937-7782fbf57380 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.355048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.356189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.356678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.357069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.357721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.359337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.370056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1170/2354] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:29:11.375064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.382740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:11.386995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49cebe20-6ee5-47fb-a493-65b2a1c193b7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.393487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ab8aa8-9fdb-4609-b1a9-5e52c4f98ca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.394328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab8aa8-9fdb-4609-b1a9-5e52c4f98ca0 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.395079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab8aa8-9fdb-4609-b1a9-5e52c4f98ca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.395533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ab8aa8-9fdb-4609-b1a9-5e52c4f98ca0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.396462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab8aa8-9fdb-4609-b1a9-5e52c4f98ca0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.398153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ab8aa8-9fdb-4609-b1a9-5e52c4f98ca0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.412671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1185/2355] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:29:11.416756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.431528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d5814-66e8-485e-a335-fe628548de78 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.437510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.438310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.438593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.438893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] PATH_INFO: `/v3/projects/d8bca0e735b3456b9f4c00efd3e76f03/users/72f45f19fde44d1c93c76edb8555b92d/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.459805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8bca0e735b3456b9f4c00efd3e76f03, user_id=72f45f19fde44d1c93c76edb8555b92d, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.462465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.477758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1171/2356] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:29:11 2022] PUT /identity/v3/projects/d8bca0e735b3456b9f4c00efd3e76f03/users/72f45f19fde44d1c93c76edb8555b92d/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:11.483709 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.484117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.484544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.504809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:11.506265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:11.580058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1186/2357] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:11.589511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.591392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:11.661885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e246376-e08b-47c6-a57b-b866c49400e6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.665614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f346c58-811c-4f9e-ab25-6ab87dbe4447 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:11.666232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346c58-811c-4f9e-ab25-6ab87dbe4447 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:11.667203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346c58-811c-4f9e-ab25-6ab87dbe4447 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:11.667482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f346c58-811c-4f9e-ab25-6ab87dbe4447 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:11.679003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346c58-811c-4f9e-ab25-6ab87dbe4447 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:11.680458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f346c58-811c-4f9e-ab25-6ab87dbe4447 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:11.696329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1172/2358] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:11.967084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:11.968624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:11.994277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f565bb-b05a-4651-9468-fb2b9c2e9648 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:11.999964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:12.000693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:12.000985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:12.001374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] PATH_INFO: `/v3/users/277acb93cc1547228bf8bb97487d5d2e` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:12.002596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] RBAC: Authorizing `identity:delete_user(user_id=277acb93cc1547228bf8bb97487d5d2e)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:12.004630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:12.089987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '277acb93cc1547228bf8bb97487d5d2e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:12.090809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '277acb93cc1547228bf8bb97487d5d2e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:12.110553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '277acb93cc1547228bf8bb97487d5d2e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:12.136383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '277acb93cc1547228bf8bb97487d5d2e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:12.149820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '277acb93cc1547228bf8bb97487d5d2e'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:12.160226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1187/2359] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:29:11 2022] DELETE /identity/v3/users/277acb93cc1547228bf8bb97487d5d2e => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:12.162352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:12.162909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:12.162997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:12.185603 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:12.186857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:12.203552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:12.293264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1173/2360] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:12.298945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:12.301957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:12.404689 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba64ff37-2e7d-403b-9e32-c1711d96f840 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:12.410011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e259970-ab91-4c33-826d-44f3a77001fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:12.410403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259970-ab91-4c33-826d-44f3a77001fb service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:12.410679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259970-ab91-4c33-826d-44f3a77001fb service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:12.411008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e259970-ab91-4c33-826d-44f3a77001fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:12.423246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e259970-ab91-4c33-826d-44f3a77001fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:12.425171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e259970-ab91-4c33-826d-44f3a77001fb service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:12.441252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1188/2361] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:12.850383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:12.852282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:12.876047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0225fcb8-10f6-4b3f-80fd-1cbd93cb8c6d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:12.891093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:12.892239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:12.892793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:12.893224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] PATH_INFO: `/v3/projects/390730ac969941e382aa2031f7416e65` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:12.894743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=390730ac969941e382aa2031f7416e65)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:12.896715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:12.942808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09518-9651-435e-ac1b-f54a3175ae18 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:12.943097 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09518-9651-435e-ac1b-f54a3175ae18 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:12.943409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d09518-9651-435e-ac1b-f54a3175ae18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:12.968852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:12.986107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d7d09518-9651-435e-ac1b-f54a3175ae18 None None] MFA Rules not processed for user `72f45f19fde44d1c93c76edb8555b92d`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:12.989338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '390730ac969941e382aa2031f7416e65', 'request_id': 'req-0a8c0098-62ac-4edf-a642-1acd30023b90'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:12.989508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d7d09518-9651-435e-ac1b-f54a3175ae18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:12.998011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '390730ac969941e382aa2031f7416e65', 'request_id': 'req-0a8c0098-62ac-4edf-a642-1acd30023b90'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:13.010501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '390730ac969941e382aa2031f7416e65', 'request_id': 'req-0a8c0098-62ac-4edf-a642-1acd30023b90'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:13.055945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] The token cache is being invalidate because project 390730ac969941e382aa2031f7416e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:29:13.056372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:13.057225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:29:13.065868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1174/2362] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:29:12 2022] DELETE /identity/v3/projects/390730ac969941e382aa2031f7416e65 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:29:13.115237 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1189/2363] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:13.126301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:13.128664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:13.254653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c0098-62ac-4edf-a642-1acd30023b90 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:13.269592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1586b-bc5f-4cd7-a322-ddbeb28fd055 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:13.270866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1586b-bc5f-4cd7-a322-ddbeb28fd055 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:13.271315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1586b-bc5f-4cd7-a322-ddbeb28fd055 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:13.271695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1586b-bc5f-4cd7-a322-ddbeb28fd055 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:13.313276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1586b-bc5f-4cd7-a322-ddbeb28fd055 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:13.314767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1586b-bc5f-4cd7-a322-ddbeb28fd055 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:13.337572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1175/2364] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:13 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:14.923651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce425d-5660-4026-b62e-a7122ae49212 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:14.924216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce425d-5660-4026-b62e-a7122ae49212 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:14.924216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dce425d-5660-4026-b62e-a7122ae49212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:14.946017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8dce425d-5660-4026-b62e-a7122ae49212 None None] MFA Rules not processed for user `72f45f19fde44d1c93c76edb8555b92d`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:14.947651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8dce425d-5660-4026-b62e-a7122ae49212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:14.957828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1190/2365] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:14 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:20.832474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53ec5-6c0c-451a-b9cc-18ae45a18637 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:20.833051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53ec5-6c0c-451a-b9cc-18ae45a18637 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:20.833051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd53ec5-6c0c-451a-b9cc-18ae45a18637 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:20.834360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1176/2366] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:29:20.840713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870995de-bfc4-4857-95c3-0092b1f6dca0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:20.841518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870995de-bfc4-4857-95c3-0092b1f6dca0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:20.841801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870995de-bfc4-4857-95c3-0092b1f6dca0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:20.862458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-870995de-bfc4-4857-95c3-0092b1f6dca0 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:20.863721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-870995de-bfc4-4857-95c3-0092b1f6dca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:20.931615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1191/2367] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:29:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:20.943249 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd53ec5-6c0c-451a-b9cc-18ae45a18637 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:20.944929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3dd53ec5-6c0c-451a-b9cc-18ae45a18637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:20.996245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:21.012411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd53ec5-6c0c-451a-b9cc-18ae45a18637 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:21.015953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bce75a2-9155-4c32-9874-a0fd7bb5cb16 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:21.016626 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce75a2-9155-4c32-9874-a0fd7bb5cb16 service glance] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.016917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce75a2-9155-4c32-9874-a0fd7bb5cb16 service glance] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.017197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bce75a2-9155-4c32-9874-a0fd7bb5cb16 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.028075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce75a2-9155-4c32-9874-a0fd7bb5cb16 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:21.029490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bce75a2-9155-4c32-9874-a0fd7bb5cb16 service glance] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:21.040127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1177/2368] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:21.107644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57fe00-aaaf-46f1-a319-c41c541b8d01 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.107888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57fe00-aaaf-46f1-a319-c41c541b8d01 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.108166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed57fe00-aaaf-46f1-a319-c41c541b8d01 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.109502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1192/2369] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:29:21.114260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8ece-7f4c-4d9d-b6b1-5699f8bc4edf None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.114550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8ece-7f4c-4d9d-b6b1-5699f8bc4edf None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.114862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53d8ece-7f4c-4d9d-b6b1-5699f8bc4edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.140674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e53d8ece-7f4c-4d9d-b6b1-5699f8bc4edf None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:21.141866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e53d8ece-7f4c-4d9d-b6b1-5699f8bc4edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:21.193004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1178/2370] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:29:21 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:21.205890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57fe00-aaaf-46f1-a319-c41c541b8d01 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:21.207588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ed57fe00-aaaf-46f1-a319-c41c541b8d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:21.221072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed57fe00-aaaf-46f1-a319-c41c541b8d01 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:21.224541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba1245-b81e-4d69-853f-3d526726bfee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:21.225133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1245-b81e-4d69-853f-3d526726bfee service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.225420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1245-b81e-4d69-853f-3d526726bfee service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.225694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba1245-b81e-4d69-853f-3d526726bfee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.233647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba1245-b81e-4d69-853f-3d526726bfee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:21.235151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba1245-b81e-4d69-853f-3d526726bfee service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:21.242861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1193/2371] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:21.327791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e49bf9-4c50-4247-b01d-8ea9daebe190 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.328108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e49bf9-4c50-4247-b01d-8ea9daebe190 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.328385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e49bf9-4c50-4247-b01d-8ea9daebe190 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.329826 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1179/2372] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:29:21.335152 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7fd9-491e-4217-9293-e1a009e6e309 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.335452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7fd9-491e-4217-9293-e1a009e6e309 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.335756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd7fd9-491e-4217-9293-e1a009e6e309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.354975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9fdd7fd9-491e-4217-9293-e1a009e6e309 None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:21.356291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9fdd7fd9-491e-4217-9293-e1a009e6e309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:21.365902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1194/2373] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:29:21 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:21.377325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e49bf9-4c50-4247-b01d-8ea9daebe190 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:21.379053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b3e49bf9-4c50-4247-b01d-8ea9daebe190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:21.392800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e49bf9-4c50-4247-b01d-8ea9daebe190 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:21.396331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:21.396921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:21.397204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:21.397480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:21.407853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:21.409269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:21.419805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1180/2374] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:29:23.599626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f245f2-6c1c-4c1c-8fd1-272ce653deed None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:23.600055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f245f2-6c1c-4c1c-8fd1-272ce653deed None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:23.600169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f245f2-6c1c-4c1c-8fd1-272ce653deed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:23.619529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-93f245f2-6c1c-4c1c-8fd1-272ce653deed None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:23.620707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-93f245f2-6c1c-4c1c-8fd1-272ce653deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:23.674908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1195/2375] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:29:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:23.686870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:23.688243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:23.756066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2bc519-ef79-4843-b263-5449e07d1900 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:23.761095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:23.761720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:23.762055 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:23.762340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:23.770138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:23.771759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:23.780446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1181/2376] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:29:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:29:33.667732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=96 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:33.776812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=67 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:42.090981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566afb-c0e3-4042-8986-b0cbd2486bf5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:42.091459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566afb-c0e3-4042-8986-b0cbd2486bf5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:42.091557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2566afb-c0e3-4042-8986-b0cbd2486bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:42.112330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b2566afb-c0e3-4042-8986-b0cbd2486bf5 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:42.113551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b2566afb-c0e3-4042-8986-b0cbd2486bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:42.120761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1196/2377] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 17 23:29:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:42.134243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:42.145440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b854e31-6839-45d0-b929-351226e674c9 service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:42.150627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:42.151241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:42.151520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:42.151790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:42.160351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:42.162016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:42.170113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1182/2378] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:29:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:29:43.571762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2942f-0feb-47c5-ac26-c02b972cc1af None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:43.572241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2942f-0feb-47c5-ac26-c02b972cc1af None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:43.572344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2942f-0feb-47c5-ac26-c02b972cc1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:43.591392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-98a2942f-0feb-47c5-ac26-c02b972cc1af None None] MFA Rules not processed for user `72f45f19fde44d1c93c76edb8555b92d`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:29:43.593403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-98a2942f-0feb-47c5-ac26-c02b972cc1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:43.600086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1197/2379] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:29:43 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:29:52.166905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=6 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:53.586778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=6 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:29:57.391586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:29:57.392996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:57.462209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a47458-9b7c-48b5-8711-bdfb270b6f4d service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:29:57.468252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:29:57.468855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:29:57.469140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:29:57.469419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:29:57.471155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:29:57.483282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:29:57.485789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:29:57.495622 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1183/2380] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:29:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:30:00.265076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72f53-b8ff-4c00-a5b3-85dcaeac9729 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:00.265576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72f53-b8ff-4c00-a5b3-85dcaeac9729 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:00.265675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed72f53-b8ff-4c00-a5b3-85dcaeac9729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:00.286489 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-5ed72f53-b8ff-4c00-a5b3-85dcaeac9729 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:00.287838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5ed72f53-b8ff-4c00-a5b3-85dcaeac9729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:00.296504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1198/2381] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:30:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:00.308781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:00.324494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e3e1c-f329-42f4-ab82-4eee7f830f7d service placement] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:00.330725 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:00.331359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:00.331640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:00.331911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:00.340283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:00.341904 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:00.350710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1184/2382] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:30:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:30:10.281368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:10.346971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=38 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:16.047902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:16.048342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:16.048440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:16.067281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:16.068467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:16.076911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1199/2383] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 17 23:30:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:16.088883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:16.099774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed5ada2-6656-4458-8203-801b8f9b656b service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:16.104591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:16.105172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:16.105453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:16.105721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:16.114339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:16.115955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:16.124480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1185/2384] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:30:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:30:18.093973 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.095588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:18.169311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a39524c-6b1d-4894-9bac-5d623da9eba0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:18.174547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:18.175275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.175559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.175837 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] PATH_INFO: `/v3/users/72f45f19fde44d1c93c76edb8555b92d` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.176958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72f45f19fde44d1c93c76edb8555b92d)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:18.178955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:18.231420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72f45f19fde44d1c93c76edb8555b92d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.232236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72f45f19fde44d1c93c76edb8555b92d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.249125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72f45f19fde44d1c93c76edb8555b92d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.258510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72f45f19fde44d1c93c76edb8555b92d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.269645 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-62e9d975-7364-4032-b731-d94e7dbfe352 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72f45f19fde44d1c93c76edb8555b92d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.280617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1200/2385] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:30:18 2022] DELETE /identity/v3/users/72f45f19fde44d1c93c76edb8555b92d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:30:18.475112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.485677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b292e-6e09-49b2-826a-452bee98a18c service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:18.549023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:18.549658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.549944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.550221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] PATH_INFO: `/v3/projects/d8bca0e735b3456b9f4c00efd3e76f03` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.551377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8bca0e735b3456b9f4c00efd3e76f03)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:18.553295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:18.607292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8bca0e735b3456b9f4c00efd3e76f03', 'request_id': 'req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.615596 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8bca0e735b3456b9f4c00efd3e76f03', 'request_id': 'req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.622621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8bca0e735b3456b9f4c00efd3e76f03', 'request_id': 'req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.634345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] The token cache is being invalidate because project d8bca0e735b3456b9f4c00efd3e76f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:30:18.634629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.635280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e8206cda-b0aa-474f-b7a3-b5dca5b183ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:18.636761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1186/2386] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:30:18 2022] DELETE /identity/v3/projects/d8bca0e735b3456b9f4c00efd3e76f03 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:30:18.642904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.643199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.643698 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.663829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:18.664959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:18.724411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1201/2387] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:18.732227 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.733174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.733438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.753540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:18.754776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:18.762654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1187/2388] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:18.766913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.777007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1be30-83bd-4def-9e75-9edca707b4d0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:18.781699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:18.782296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.782584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.782903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.783561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:30:18.783869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:18.785468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:18.793962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:18.798324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1202/2389] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:30:18.802618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.812225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad8d80-8cc0-4060-bc47-d36f1c721213 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:18.816912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:18.817509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.817794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.818068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.818727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:18.820636 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:18.848549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1188/2390] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:30:18 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:30:18.852772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.862957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc3d080-8498-4bff-997f-f9b4de069602 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:18.922694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:18.923287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.923570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.923845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.924478 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:18.926403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:18.948059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1203/2391] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:30:18 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:30:18.952929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.963271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2812eb9-5812-499d-91f5-9548efdcc86d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:18.968769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:18.969371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:18.969649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:18.969920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:18.970559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:18.972181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:18.982811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1189/2392] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:30:18.986691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:18.996556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da640154-0924-443d-8d7a-045d9b77315c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:19.001954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12b29d-a431-45f7-aed1-4e29ffd381a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:19.002553 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b29d-a431-45f7-aed1-4e29ffd381a1 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.002874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b29d-a431-45f7-aed1-4e29ffd381a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.003154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12b29d-a431-45f7-aed1-4e29ffd381a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.003796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12b29d-a431-45f7-aed1-4e29ffd381a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:19.005392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12b29d-a431-45f7-aed1-4e29ffd381a1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:19.016646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1204/2393] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:30:19.021014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:19.031312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e2b3ab-7113-456c-b3f8-d568a22a89e0 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:19.035830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:19.036463 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.036740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.037015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] PATH_INFO: `/v3/projects/f7baee891b734221bc74ae168b648cdc/users/50f7c48c7b9a4ece9f21e3fbd64c4ec0/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.051567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7baee891b734221bc74ae168b648cdc, user_id=50f7c48c7b9a4ece9f21e3fbd64c4ec0, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:19.054199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:19.067398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1190/2394] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:30:19 2022] PUT /identity/v3/projects/f7baee891b734221bc74ae168b648cdc/users/50f7c48c7b9a4ece9f21e3fbd64c4ec0/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:30:19.077938 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.078225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.078501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.105047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] MFA Rules not processed for user `50f7c48c7b9a4ece9f21e3fbd64c4ec0`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:19.106243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:19.169222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1205/2395] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:19.181252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:19.182962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:19.197920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:19.242633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9d7b52-b15c-4b69-bf86-eb447a330e1e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:19.246267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c6ae69-9d20-44a4-8a58-2399c49af9e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:19.246921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ae69-9d20-44a4-8a58-2399c49af9e4 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.247207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ae69-9d20-44a4-8a58-2399c49af9e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.247482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c6ae69-9d20-44a4-8a58-2399c49af9e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.256480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ae69-9d20-44a4-8a58-2399c49af9e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:19.258098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c6ae69-9d20-44a4-8a58-2399c49af9e4 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:19.267655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1191/2396] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:30:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:30:19.294322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:19.356119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c212e-9719-4572-89aa-3ddcad89a23c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:19.361452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:19.362073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.362353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.362627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] PATH_INFO: `/v3/users/50f7c48c7b9a4ece9f21e3fbd64c4ec0` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.363773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50f7c48c7b9a4ece9f21e3fbd64c4ec0)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:19.365681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:19.377162 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:19.417062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50f7c48c7b9a4ece9f21e3fbd64c4ec0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.417733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50f7c48c7b9a4ece9f21e3fbd64c4ec0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.431076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50f7c48c7b9a4ece9f21e3fbd64c4ec0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.439112 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50f7c48c7b9a4ece9f21e3fbd64c4ec0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.446202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50f7c48c7b9a4ece9f21e3fbd64c4ec0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.452386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1206/2397] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:30:19 2022] DELETE /identity/v3/users/50f7c48c7b9a4ece9f21e3fbd64c4ec0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:30:19.456803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.457092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.457366 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.476548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:19.478038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:19.543649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1192/2398] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:19.553171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:19.554563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:19.612872 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70598a78-d7e8-400f-b247-f3b466f5c127 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:19.616473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ca29d-5505-4dad-a755-9dba9c48bcbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:19.617077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ca29d-5505-4dad-a755-9dba9c48bcbd service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.617378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ca29d-5505-4dad-a755-9dba9c48bcbd service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.617635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ca29d-5505-4dad-a755-9dba9c48bcbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.626432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ca29d-5505-4dad-a755-9dba9c48bcbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:19.627888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ca29d-5505-4dad-a755-9dba9c48bcbd service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:19.637196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1207/2399] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:30:19.906951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:30:19.908415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:19.926315 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee62e9e-d91a-463a-9a36-91fb90bc006a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:30:19.931177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:30:19.932089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:19.932415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:19.932765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] PATH_INFO: `/v3/projects/f7baee891b734221bc74ae168b648cdc` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:19.933940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7baee891b734221bc74ae168b648cdc)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:30:19.936191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:30:19.985274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7baee891b734221bc74ae168b648cdc', 'request_id': 'req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.990736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7baee891b734221bc74ae168b648cdc', 'request_id': 'req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:19.998936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7baee891b734221bc74ae168b648cdc', 'request_id': 'req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:20.009905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] The token cache is being invalidate because project f7baee891b734221bc74ae168b648cdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:30:20.010198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:20.010866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c1a2840c-2c33-4165-a2e7-f7bfbf7395f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:30:20.012346 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1193/2400] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:30:19 2022] DELETE /identity/v3/projects/f7baee891b734221bc74ae168b648cdc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:30:27.783824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3b53-10f4-434c-8e2f-62773db7b3ff None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:27.784353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3b53-10f4-434c-8e2f-62773db7b3ff None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:27.784353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef3b53-10f4-434c-8e2f-62773db7b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:27.805834 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6bef3b53-10f4-434c-8e2f-62773db7b3ff None None] MFA Rules not processed for user `8c10c73d9ffa4f849c45e77926c0b0ce`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:27.807100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6bef3b53-10f4-434c-8e2f-62773db7b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:27.865318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1208/2401] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:30.006986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:33.946834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:33.947438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:33.947438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:33.971178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] MFA Rules not processed for user `c7e73f3bfbcd41b29dc41bbbd218d413`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:33.973088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:34.068165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1194/2402] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:33 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:37.858843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=10,keystone:SELECT=73,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:44.056976 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=25 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:30:46.299292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:30:46.300020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:30:46.300331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:30:46.319125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] MFA Rules not processed for user `31b0201bf57647b1b71e0a7bc592bf3a`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:30:46.320355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:30:46.377674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1209/2403] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:30:46 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:30:56.370721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=25 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:30.018852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.020823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:30.097129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0c072f-91f6-4791-af3f-d4e7ba43a80c None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.101772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.102413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.102748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.103019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] PATH_INFO: `/v3/users/8c10c73d9ffa4f849c45e77926c0b0ce` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.104138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c10c73d9ffa4f849c45e77926c0b0ce)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.106138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.156932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c10c73d9ffa4f849c45e77926c0b0ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.170001 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c10c73d9ffa4f849c45e77926c0b0ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.177620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c10c73d9ffa4f849c45e77926c0b0ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.178255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c10c73d9ffa4f849c45e77926c0b0ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.185104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e669dfc1-bafb-4815-9aa5-bf16ab3aec7b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c10c73d9ffa4f849c45e77926c0b0ce'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.191697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1195/2404] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:30 2022] DELETE /identity/v3/users/8c10c73d9ffa4f849c45e77926c0b0ce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:30.438585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.449841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c493b-6b3a-475d-a8eb-4b0cc72a8442 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.515906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.516566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.516992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.517512 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] PATH_INFO: `/v3/projects/9b8caca59d52493c95a09b516b21d514` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.519839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b8caca59d52493c95a09b516b21d514)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.521750 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.568077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b8caca59d52493c95a09b516b21d514', 'request_id': 'req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.573374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b8caca59d52493c95a09b516b21d514', 'request_id': 'req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.580676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b8caca59d52493c95a09b516b21d514', 'request_id': 'req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.591317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] The token cache is being invalidate because project 9b8caca59d52493c95a09b516b21d514 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:30.591605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.592225 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-abd8e0ac-c5eb-42f4-8b3d-6d1855c0c7b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:30.593818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1210/2405] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:30 2022] DELETE /identity/v3/projects/9b8caca59d52493c95a09b516b21d514 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:30.599175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.599460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.599733 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.619869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:30.621075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:30.678864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1196/2406] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:30.687156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.687446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.687723 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.707781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:30.709018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:30.716979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1211/2407] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:30.722894 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.733477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b641381f-52e3-4c09-8527-98d3f458e621 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.738025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.738621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.738935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.739213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.739866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:31:30.740173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.741766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.753974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1197/2408] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:31:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:31:30.758376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.768186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16dd30d-74c5-4aa4-a11e-96597f691b7f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.772862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.773458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.773742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.774018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.774639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.776840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.808858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1212/2409] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:30 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:30.813289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.823310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e1b817-43e2-4e30-be04-9b8dafe01ae9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.827568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:30.881562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.882162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.882441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.882728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.883355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.885325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.907345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1198/2410] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:30 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:30.911584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.922021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940e33f5-0d48-49ae-9722-580fe499ba41 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.926635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.927256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.927539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.927813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.928486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.930125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.940232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1213/2411] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:30.943896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.954597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c71eb65-537a-442f-809e-499146d84206 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.959174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1391376e-3875-4599-9774-fb5a837e3c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.959757 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391376e-3875-4599-9774-fb5a837e3c7e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.960039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391376e-3875-4599-9774-fb5a837e3c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.960312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1391376e-3875-4599-9774-fb5a837e3c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:30.960944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391376e-3875-4599-9774-fb5a837e3c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:30.962518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1391376e-3875-4599-9774-fb5a837e3c7e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:30.973347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1199/2412] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:30.977387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:30.988060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a84889-bcdc-4992-adc6-6d5feba7028c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:30.994639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:30.995352 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:30.995638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:30.995917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] PATH_INFO: `/v3/projects/0b08484bd6c14dcd82fcfa33236d0d69/users/f4137f5953c944388ad0b5e91f8d5ff4/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.011843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b08484bd6c14dcd82fcfa33236d0d69, user_id=f4137f5953c944388ad0b5e91f8d5ff4, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.015251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.028771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1214/2413] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:30 2022] PUT /identity/v3/projects/0b08484bd6c14dcd82fcfa33236d0d69/users/f4137f5953c944388ad0b5e91f8d5ff4/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:31.039006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.039529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.039638 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.075112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] MFA Rules not processed for user `f4137f5953c944388ad0b5e91f8d5ff4`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:31.076350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:31.143504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1200/2414] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:31.147934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.178327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:31.212117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5087871-331a-48ab-8d63-42e8480ada30 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.216755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.218127 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.218635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.218635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.219309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.221211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.247029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1215/2415] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:31 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:31:31.251106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.261660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9df27e-3779-4659-a43b-b1a6a58c6974 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.319072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.319706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.319991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.320267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.320901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.322853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.344418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1201/2416] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:31 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:31.348422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.358574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aa5ddd-45a3-4d37-8891-d394fbb85707 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.363461 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.364056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.364340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.364616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.365293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.366923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.377147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1216/2417] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:31.381095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.387432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:31.392140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e1b546-30e1-47b6-ae53-6e586e5f113f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.398062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.398756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.399259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.399541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] PATH_INFO: `/v3/projects/5c08300a08e5475aaf4167483dd16c6d/users/6ee8a3bad8cf49d1829d2bfc05cdf2a0/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.415219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c08300a08e5475aaf4167483dd16c6d, user_id=6ee8a3bad8cf49d1829d2bfc05cdf2a0, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.417851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.430738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1202/2418] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:31 2022] PUT /identity/v3/projects/5c08300a08e5475aaf4167483dd16c6d/users/6ee8a3bad8cf49d1829d2bfc05cdf2a0/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:31.434999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.446228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374a2183-75df-4a59-b8dd-61d19761033f admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.503966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf59ff1e-411e-4ee6-9b4d-ccd8b94f2df1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.504571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59ff1e-411e-4ee6-9b4d-ccd8b94f2df1 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.504855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59ff1e-411e-4ee6-9b4d-ccd8b94f2df1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.505142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf59ff1e-411e-4ee6-9b4d-ccd8b94f2df1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.505796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59ff1e-411e-4ee6-9b4d-ccd8b94f2df1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.507556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf59ff1e-411e-4ee6-9b4d-ccd8b94f2df1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.518667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1217/2419] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:31 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:31.523330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.534536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a215732c-6403-47b9-a014-86ec099af366 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.539132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.539777 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.540060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.540331 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] PATH_INFO: `/v3/projects/5c08300a08e5475aaf4167483dd16c6d/users/6ee8a3bad8cf49d1829d2bfc05cdf2a0/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.542356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c08300a08e5475aaf4167483dd16c6d, user_id=6ee8a3bad8cf49d1829d2bfc05cdf2a0, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.545024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.555827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1203/2420] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:31 2022] PUT /identity/v3/projects/5c08300a08e5475aaf4167483dd16c6d/users/6ee8a3bad8cf49d1829d2bfc05cdf2a0/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:31.567294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.567579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.567851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.596910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] MFA Rules not processed for user `6ee8a3bad8cf49d1829d2bfc05cdf2a0`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:31.598134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:31.672316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1218/2421] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:31.684888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:31.687754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:31.746718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f345919-8a33-4468-b38f-4d9fde489e56 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:31.750738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05396551-bdc8-40ad-ad2b-a0c9f889dd64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:31.751292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05396551-bdc8-40ad-ad2b-a0c9f889dd64 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:31.751573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05396551-bdc8-40ad-ad2b-a0c9f889dd64 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:31.751846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05396551-bdc8-40ad-ad2b-a0c9f889dd64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:31.760902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05396551-bdc8-40ad-ad2b-a0c9f889dd64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:31.762318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05396551-bdc8-40ad-ad2b-a0c9f889dd64 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:31.771618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1204/2422] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:32.180477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:32.207297 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:32.247188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3796fe05-87a6-4301-bf08-5c83da4dc492 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:32.251768 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:32.252463 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:32.252677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:32.252976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] PATH_INFO: `/v3/users/f4137f5953c944388ad0b5e91f8d5ff4` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:32.254105 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4137f5953c944388ad0b5e91f8d5ff4)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:32.256047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:32.308933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4137f5953c944388ad0b5e91f8d5ff4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.309593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4137f5953c944388ad0b5e91f8d5ff4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.322773 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4137f5953c944388ad0b5e91f8d5ff4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.330962 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4137f5953c944388ad0b5e91f8d5ff4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.340157 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4137f5953c944388ad0b5e91f8d5ff4'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.346101 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1219/2423] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:32 2022] DELETE /identity/v3/users/f4137f5953c944388ad0b5e91f8d5ff4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:32.350528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:32.351023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:32.351124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:32.370033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:32.371246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:32.430745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1205/2424] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:32.440556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:32.441983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:32.505274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6ce90-d678-4872-bc21-f1670be47685 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:32.508795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:32.509396 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:32.509675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:32.509946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:32.518965 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:32.520374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:32.530276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1220/2425] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:32.885503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:32.887059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:32.899690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba166-ccef-44aa-98e8-24613d3616a4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:32.905690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:32.906367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:32.906650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:32.906953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] PATH_INFO: `/v3/projects/0b08484bd6c14dcd82fcfa33236d0d69` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:32.908128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b08484bd6c14dcd82fcfa33236d0d69)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:32.910092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:32.958597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b08484bd6c14dcd82fcfa33236d0d69', 'request_id': 'req-7bbeba81-14fd-4d25-88d8-fe951a3c601e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.964208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b08484bd6c14dcd82fcfa33236d0d69', 'request_id': 'req-7bbeba81-14fd-4d25-88d8-fe951a3c601e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.971585 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b08484bd6c14dcd82fcfa33236d0d69', 'request_id': 'req-7bbeba81-14fd-4d25-88d8-fe951a3c601e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.972706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:32.984730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] The token cache is being invalidate because project 0b08484bd6c14dcd82fcfa33236d0d69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:32.985038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.985686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:32.987792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1206/2426] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:32 2022] DELETE /identity/v3/projects/0b08484bd6c14dcd82fcfa33236d0d69 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:32.991208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.001566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9556ba97-6a7b-42ac-b005-e41bcd9fc88e service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.046913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:33.064618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.065259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.065544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.065826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] PATH_INFO: `/v3/users/6ee8a3bad8cf49d1829d2bfc05cdf2a0` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.067065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ee8a3bad8cf49d1829d2bfc05cdf2a0)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.069038 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:33.116677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ee8a3bad8cf49d1829d2bfc05cdf2a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.117330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ee8a3bad8cf49d1829d2bfc05cdf2a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.129550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ee8a3bad8cf49d1829d2bfc05cdf2a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.138286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ee8a3bad8cf49d1829d2bfc05cdf2a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.145835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1c1739d8-afdb-4fa1-8a8a-d8cc3e53a67c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ee8a3bad8cf49d1829d2bfc05cdf2a0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.151947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1221/2427] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:32 2022] DELETE /identity/v3/users/6ee8a3bad8cf49d1829d2bfc05cdf2a0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:33.432294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.434621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:33.448136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbeba81-14fd-4d25-88d8-fe951a3c601e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.538493 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.539301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.539640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.539922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] PATH_INFO: `/v3/projects/5c08300a08e5475aaf4167483dd16c6d` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.541151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c08300a08e5475aaf4167483dd16c6d)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.543160 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:33.591127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c08300a08e5475aaf4167483dd16c6d', 'request_id': 'req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.597885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c08300a08e5475aaf4167483dd16c6d', 'request_id': 'req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.605010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c08300a08e5475aaf4167483dd16c6d', 'request_id': 'req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.616814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] The token cache is being invalidate because project 5c08300a08e5475aaf4167483dd16c6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:33.617112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.617763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45fc9e43-d625-4382-aa8d-1acbedcdb6eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:33.619300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1207/2428] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:33 2022] DELETE /identity/v3/projects/5c08300a08e5475aaf4167483dd16c6d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:33.625471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.625969 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.626060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.646322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:33.647563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:33.707271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1222/2429] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:33.715176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.715470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.715750 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.739767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:33.740992 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:33.749134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1208/2430] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:33.753483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.763368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf52638d-9fc0-4388-8d6a-f4e0142737c9 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.768609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.769211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.769498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.769783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.770465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:31:33.770807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.772430 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:33.784670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1223/2431] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:31:33.789071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.798936 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd726be-f64d-4f98-b802-d2887e38bfeb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.803558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.804153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.804439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.804742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.805348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.807287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:33.834027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1209/2432] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:33 2022] POST /identity/v3/projects => generated 409 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:33.838004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.848566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4e32e8-4614-41b3-a160-bb01ef8c739d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.895187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:33.907403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.908022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.908477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.909082 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.909913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.911849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:33.933817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1224/2433] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:33 2022] POST /identity/v3/users => generated 305 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:31:33.938260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.948909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e944153-85d1-4d15-bf71-fbdd180a653c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.953632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.954272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.954559 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.954868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.955521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.957114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:33.967933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1210/2434] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:33.971993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:33.982156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b453f0-3458-4ff1-9a7d-c726237eeb14 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:33.987155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85eb7ca-d999-4039-94ea-8235d3b3b4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:33.987771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85eb7ca-d999-4039-94ea-8235d3b3b4d7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:33.988056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85eb7ca-d999-4039-94ea-8235d3b3b4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:33.988338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85eb7ca-d999-4039-94ea-8235d3b3b4d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:33.988987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85eb7ca-d999-4039-94ea-8235d3b3b4d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:33.990586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85eb7ca-d999-4039-94ea-8235d3b3b4d7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.001652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1225/2435] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:34.005959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.016191 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622bfd9c-15fa-4231-b429-46f074dccde4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.020882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.021540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.021823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.022102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] PATH_INFO: `/v3/projects/4bc319ac20c148f1810a7fa684701577/users/f373111f511343db9e85cb28be58d187/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.037957 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bc319ac20c148f1810a7fa684701577, user_id=f373111f511343db9e85cb28be58d187, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.040651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.056270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1211/2436] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:34 2022] PUT /identity/v3/projects/4bc319ac20c148f1810a7fa684701577/users/f373111f511343db9e85cb28be58d187/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:34.066262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.066619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.066991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.098435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] MFA Rules not processed for user `f373111f511343db9e85cb28be58d187`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:34.099743 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:34.162561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1226/2437] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:34 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:34.167151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.188388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:34.230854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac661d76-c2a1-4d89-95e6-e7b339ba1e11 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.236612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.237209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.237489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.237762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.238376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.240309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.265407 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1212/2438] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:34 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:34.269532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.281106 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96df89ef-6f7e-4293-821b-44d1cd079690 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.336985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.337641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.337922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.338191 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.338874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.340785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.361878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1227/2439] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:34 2022] POST /identity/v3/users => generated 311 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:34.365770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.376479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3801909-5286-40e3-a882-0698c4130c0b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.380993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.381741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.381862 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.382129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.382801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.384386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.394683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1213/2440] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:34.398581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.409020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c675a4-9a87-432c-81ef-f8a06ee1850d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.413771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.414238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.414522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.414833 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] PATH_INFO: `/v3/projects/4dc3143f4b264f6bb031fc1ff8b680c6/users/2bd697f6767a4b5291be3ecf049fe795/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.429915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc3143f4b264f6bb031fc1ff8b680c6, user_id=2bd697f6767a4b5291be3ecf049fe795, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.432617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.446234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1228/2441] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:34 2022] PUT /identity/v3/projects/4dc3143f4b264f6bb031fc1ff8b680c6/users/2bd697f6767a4b5291be3ecf049fe795/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:34.450435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.461338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c760739e-1b3d-4cbb-b23f-7abd94821ac6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.516612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4586693-d9ac-4aec-870a-b11d3c626533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.517218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4586693-d9ac-4aec-870a-b11d3c626533 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.517499 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4586693-d9ac-4aec-870a-b11d3c626533 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.517773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4586693-d9ac-4aec-870a-b11d3c626533 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.518415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4586693-d9ac-4aec-870a-b11d3c626533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.520042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4586693-d9ac-4aec-870a-b11d3c626533 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.530387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1214/2442] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:34 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:31:34.534527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.544765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d6303b-fac9-4854-b0e0-caa69115c04b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.549808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.550587 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.551036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.551662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] PATH_INFO: `/v3/projects/4dc3143f4b264f6bb031fc1ff8b680c6/users/2bd697f6767a4b5291be3ecf049fe795/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.554373 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc3143f4b264f6bb031fc1ff8b680c6, user_id=2bd697f6767a4b5291be3ecf049fe795, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.557608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.569857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1229/2443] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:34 2022] PUT /identity/v3/projects/4dc3143f4b264f6bb031fc1ff8b680c6/users/2bd697f6767a4b5291be3ecf049fe795/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:34.581866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.582153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.582429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.612489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] MFA Rules not processed for user `2bd697f6767a4b5291be3ecf049fe795`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:34.613667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:34.683833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1215/2444] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:34 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:34.695447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.697467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:34.712670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:34.760573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952cf87e-52b1-4407-b367-e58688071383 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.764941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185f595-d587-45e3-8d78-fde446cadfe8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.765673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f595-d587-45e3-8d78-fde446cadfe8 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.765954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f595-d587-45e3-8d78-fde446cadfe8 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.766227 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185f595-d587-45e3-8d78-fde446cadfe8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.775231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f595-d587-45e3-8d78-fde446cadfe8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:34.776925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185f595-d587-45e3-8d78-fde446cadfe8 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:34.786202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1230/2445] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:34 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:34.935079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:34.945187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a3746a-9707-4dac-989d-185ed1cf6ecd None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:34.948762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:34.949365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:34.949646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:34.949920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:34.962647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:35.010521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:35.012013 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:35.022095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1216/2446] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:34 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:39.249123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:39.249624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:39.249974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:39.274108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:39.276204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:39.350767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1231/2447] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:31:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:39.408930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:39.410375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:39.492190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a34ca8-e3d7-4257-ba31-1c79d5e4f079 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:39.497198 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25f045-06f3-4347-b35f-dcc39832ccb1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:39.497804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f045-06f3-4347-b35f-dcc39832ccb1 service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:39.498085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f045-06f3-4347-b35f-dcc39832ccb1 service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:39.498968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25f045-06f3-4347-b35f-dcc39832ccb1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:39.507384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25f045-06f3-4347-b35f-dcc39832ccb1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:39.508972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba25f045-06f3-4347-b35f-dcc39832ccb1 service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:39.517810 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1217/2448] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:31:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:31:40.458963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:40.540339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a43734-8e87-48a8-be67-95cdbf860099 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:40.547963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:40.548958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:40.549442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:40.549912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] PATH_INFO: `/v3/users/f373111f511343db9e85cb28be58d187` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:40.551335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f373111f511343db9e85cb28be58d187)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:40.553356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:40.627744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f373111f511343db9e85cb28be58d187'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:40.629014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f373111f511343db9e85cb28be58d187'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:40.642089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:40.645059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f373111f511343db9e85cb28be58d187'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:40.663337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f373111f511343db9e85cb28be58d187'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:40.676473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f373111f511343db9e85cb28be58d187'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:40.687058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1232/2449] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:40 2022] DELETE /identity/v3/users/f373111f511343db9e85cb28be58d187 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:40.691556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:40.692029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:40.692123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:40.715507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:40.719288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:40.801251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1218/2450] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:40.810926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:40.816345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:40.893247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2130861-280e-48ee-a771-1b40fcad3b91 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:40.896898 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:40.897519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:40.897808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:40.898087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:40.908877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:40.910125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:40.921223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1233/2451] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:41.327102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:41.328822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:41.341320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7bc04-e1ed-4476-9ced-ce20ecf4ef30 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:41.347004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:41.347709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:41.347999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:41.348278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] PATH_INFO: `/v3/projects/4bc319ac20c148f1810a7fa684701577` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:41.349472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bc319ac20c148f1810a7fa684701577)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:41.351580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:41.418028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:41.428555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bc319ac20c148f1810a7fa684701577', 'request_id': 'req-644042b7-67ae-4500-87ed-d6b73bf27027'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.436436 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bc319ac20c148f1810a7fa684701577', 'request_id': 'req-644042b7-67ae-4500-87ed-d6b73bf27027'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.449446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bc319ac20c148f1810a7fa684701577', 'request_id': 'req-644042b7-67ae-4500-87ed-d6b73bf27027'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.474933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] The token cache is being invalidate because project 4bc319ac20c148f1810a7fa684701577 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:41.474933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.474933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.479595 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1219/2452] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:41 2022] DELETE /identity/v3/projects/4bc319ac20c148f1810a7fa684701577 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:41.481136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:41.501681 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0541759-3524-4155-84c6-5bccc8a4b3eb service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:41.583910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:41.584714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:41.585002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:41.585279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] PATH_INFO: `/v3/users/2bd697f6767a4b5291be3ecf049fe795` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:41.586409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2bd697f6767a4b5291be3ecf049fe795)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:41.590997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:41.656232 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2bd697f6767a4b5291be3ecf049fe795'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.657055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2bd697f6767a4b5291be3ecf049fe795'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.674492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2bd697f6767a4b5291be3ecf049fe795'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.686497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2bd697f6767a4b5291be3ecf049fe795'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.694436 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-162a90c3-bd27-48c4-ab8c-bd55f507432a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2bd697f6767a4b5291be3ecf049fe795'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:41.697035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:41.701810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1234/2453] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:41 2022] DELETE /identity/v3/users/2bd697f6767a4b5291be3ecf049fe795 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:42.133065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.135030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:42.151237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644042b7-67ae-4500-87ed-d6b73bf27027 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.225763 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.226614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.226990 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.227341 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] PATH_INFO: `/v3/projects/4dc3143f4b264f6bb031fc1ff8b680c6` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.228572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc3143f4b264f6bb031fc1ff8b680c6)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.230641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.289949 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc3143f4b264f6bb031fc1ff8b680c6', 'request_id': 'req-86b00b23-a18a-456b-8bf5-e223e7cb6c60'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:42.297304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc3143f4b264f6bb031fc1ff8b680c6', 'request_id': 'req-86b00b23-a18a-456b-8bf5-e223e7cb6c60'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:42.306213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc3143f4b264f6bb031fc1ff8b680c6', 'request_id': 'req-86b00b23-a18a-456b-8bf5-e223e7cb6c60'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:42.320777 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] The token cache is being invalidate because project 4dc3143f4b264f6bb031fc1ff8b680c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:42.321104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:42.321758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-86b00b23-a18a-456b-8bf5-e223e7cb6c60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:42.326974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1220/2454] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:42 2022] DELETE /identity/v3/projects/4dc3143f4b264f6bb031fc1ff8b680c6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:42.329040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.329409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.329714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.355289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:42.356598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:42.439523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1235/2455] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:42.447511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.447805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.448083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.468729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:42.469979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:42.478690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1221/2456] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:42.483502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.493381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf3b01-2639-4bf2-b666-b13f67d10694 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.498195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.498846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.499134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.499412 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.500073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:31:42.500406 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.502017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.515187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1236/2457] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:31:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:31:42.519566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.530881 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5fa3b-fefd-4dce-856f-719f2d1eaa39 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.536057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.536955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.537250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.537523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.538161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.540189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.583860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1222/2458] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:42 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:31:42.588451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.599910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1cca32-c0ed-46b8-9db6-5e323bcf8778 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.683292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.684028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.684319 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.684602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.685258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.692893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.731021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1237/2459] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:42 2022] POST /identity/v3/users => generated 287 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:31:42.735531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.747808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26c305-ce52-4ebb-9e39-193789fd0bd4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.760705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.761511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.761796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.762071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.762952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.764870 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.782532 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1223/2460] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:42.783984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.804879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9464ecfd-3d35-4f06-abcd-09543989b744 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.815948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785555ef-178d-483e-be72-d96b12ec753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.816586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785555ef-178d-483e-be72-d96b12ec753e admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.816873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785555ef-178d-483e-be72-d96b12ec753e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.817150 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785555ef-178d-483e-be72-d96b12ec753e admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.817808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785555ef-178d-483e-be72-d96b12ec753e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.821137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785555ef-178d-483e-be72-d96b12ec753e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.836482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1238/2461] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:42.837381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:42.850628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698602eb-1474-4c75-a3ed-7ef817e6458e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:42.856021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:42.857006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.858011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.858491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] PATH_INFO: `/v3/projects/89a875ea72394c3ab79f98fc11428ef9/users/af9b1ccede57457095fbfac1f34ac797/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.887075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=89a875ea72394c3ab79f98fc11428ef9, user_id=af9b1ccede57457095fbfac1f34ac797, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:42.890613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:42.893413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:42.923200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1224/2462] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:42 2022] PUT /identity/v3/projects/89a875ea72394c3ab79f98fc11428ef9/users/af9b1ccede57457095fbfac1f34ac797/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:42.930168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:42.930629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:42.931028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:42.990411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] MFA Rules not processed for user `af9b1ccede57457095fbfac1f34ac797`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:42.992066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:43.082337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:43.103469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1239/2463] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:43.105045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.203790 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9131ee46-b579-4827-9a07-5f55aba8ac7b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.210455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.210455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.210455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.210455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.211507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.213678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.251434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1225/2464] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:43 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:43.255306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.271272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86e300-5b63-4ea1-8b48-754f686966ff None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.349388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.350456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.350854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.351205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.351915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.354103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.390944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1240/2465] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:43 2022] POST /identity/v3/users => generated 293 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:43.394897 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.408041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212b6dce-2f4f-495e-adaa-0e353a70aeb9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.413162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.413871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.414371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.414744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.415658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.417364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.434184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1226/2466] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:43.438310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.449073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307f9fa8-aabe-4a38-bca6-828c725f3f2c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.457444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.458482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.459089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.459438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] PATH_INFO: `/v3/projects/14a1fdf394b64326b3cd5a3b5588ec8a/users/4140d60822c648eaaae6be7731d80623/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.479015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a1fdf394b64326b3cd5a3b5588ec8a, user_id=4140d60822c648eaaae6be7731d80623, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.481857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.503006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1241/2467] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:43 2022] PUT /identity/v3/projects/14a1fdf394b64326b3cd5a3b5588ec8a/users/4140d60822c648eaaae6be7731d80623/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:43.507067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.521041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52b1a1-89c7-4f6f-a939-3820c4d88312 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.603374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02124315-03f3-4240-947d-4f0abd19ba6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.604307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124315-03f3-4240-947d-4f0abd19ba6b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.604876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124315-03f3-4240-947d-4f0abd19ba6b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.605302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02124315-03f3-4240-947d-4f0abd19ba6b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.606112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124315-03f3-4240-947d-4f0abd19ba6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.607789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02124315-03f3-4240-947d-4f0abd19ba6b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.621908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1227/2468] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:43.623327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.634448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dce117-1979-40c7-8b7d-b85aa465b923 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.641562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.642242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.642525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.642843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] PATH_INFO: `/v3/projects/14a1fdf394b64326b3cd5a3b5588ec8a/users/4140d60822c648eaaae6be7731d80623/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.644787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a1fdf394b64326b3cd5a3b5588ec8a, user_id=4140d60822c648eaaae6be7731d80623, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.647507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.668507 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1242/2469] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:43 2022] PUT /identity/v3/projects/14a1fdf394b64326b3cd5a3b5588ec8a/users/4140d60822c648eaaae6be7731d80623/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:43.672150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.672646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.672770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.704544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] MFA Rules not processed for user `4140d60822c648eaaae6be7731d80623`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:43.705581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:43.771168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:43.797932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1228/2470] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:43 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:43.809892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:43.812440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:43.882957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7edf651-fc62-4296-bfc6-9d0fd7891d20 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:43.886975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:43.887666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:43.890786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:43.890786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:43.956258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:43.957617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:43.968789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1243/2471] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:43 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:46.627511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:46.701958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d16c4d1-0760-4461-b89d-0605a75bd443 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:46.707124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:46.707759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:46.708048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:46.708537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] PATH_INFO: `/v3/users/af9b1ccede57457095fbfac1f34ac797` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:46.710789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9b1ccede57457095fbfac1f34ac797)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:46.713343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:46.786695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9b1ccede57457095fbfac1f34ac797'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:46.804591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:46.806315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:46.813459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:46.814528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9b1ccede57457095fbfac1f34ac797'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:46.829154 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9b1ccede57457095fbfac1f34ac797'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:46.830328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9b1ccede57457095fbfac1f34ac797'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:46.843316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bfa7f9b1-ca88-460c-a1ea-4e17f862fced admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9b1ccede57457095fbfac1f34ac797'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:46.856308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1229/2472] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:46 2022] DELETE /identity/v3/users/af9b1ccede57457095fbfac1f34ac797 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:46.857618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:46.857913 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:46.858193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:46.883132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:46.884477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:46.926411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b9c393-9f45-4b22-af8d-2a954a83d426 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:46.957978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1230/2473] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:31:46.969152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:46.971952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:47.004263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:47.008642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:47.009279 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:47.009552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:47.009829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:47.012933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:47.068708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0d07dd-4685-43d2-baf7-3983bcbabda9 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:47.082882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:47.083521 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:47.083807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:47.084085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:47.104146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:47.108444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:47.120951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1231/2474] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:31:47.136534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:47.139519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:47.163490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1244/2475] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:47.554640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:47.556332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:47.581825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce3f44-3100-4ad0-afd6-731ae1c4d01a service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:47.618685 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:47.621860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:47.623674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:47.623982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] PATH_INFO: `/v3/projects/89a875ea72394c3ab79f98fc11428ef9` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:47.625563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89a875ea72394c3ab79f98fc11428ef9)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:47.628529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:47.687580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89a875ea72394c3ab79f98fc11428ef9', 'request_id': 'req-f42813ff-cce4-41e4-9562-dcd1b8b05499'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.694481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89a875ea72394c3ab79f98fc11428ef9', 'request_id': 'req-f42813ff-cce4-41e4-9562-dcd1b8b05499'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.707933 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89a875ea72394c3ab79f98fc11428ef9', 'request_id': 'req-f42813ff-cce4-41e4-9562-dcd1b8b05499'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.721176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] The token cache is being invalidate because project 89a875ea72394c3ab79f98fc11428ef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:47.721468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.722126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.723664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1232/2476] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:47 2022] DELETE /identity/v3/projects/89a875ea72394c3ab79f98fc11428ef9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:47.727917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:47.740981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c649b7a7-c999-42fa-a2a9-4ebd47426970 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:47.806597 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:47.807874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:47.808284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:47.808656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] PATH_INFO: `/v3/users/4140d60822c648eaaae6be7731d80623` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:47.810197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4140d60822c648eaaae6be7731d80623)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:47.812666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:47.814606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:47.874669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4140d60822c648eaaae6be7731d80623'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.875280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4140d60822c648eaaae6be7731d80623'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.891316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4140d60822c648eaaae6be7731d80623'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.900408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4140d60822c648eaaae6be7731d80623'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.911810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4140d60822c648eaaae6be7731d80623'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:47.917993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1245/2477] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:47 2022] DELETE /identity/v3/users/4140d60822c648eaaae6be7731d80623 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:48.247421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:48.249925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:48.272678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42813ff-cce4-41e4-9562-dcd1b8b05499 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:48.362028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:48.363167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:48.363610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:48.364079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] PATH_INFO: `/v3/projects/14a1fdf394b64326b3cd5a3b5588ec8a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:48.365430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a1fdf394b64326b3cd5a3b5588ec8a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:48.368150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:48.387779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:48.390619 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:48.452122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:48.464583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a1fdf394b64326b3cd5a3b5588ec8a', 'request_id': 'req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:48.471891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a1fdf394b64326b3cd5a3b5588ec8a', 'request_id': 'req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:48.476376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687fe17-a0f4-4464-bdb1-441b7153ebd0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:48.480752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a1fdf394b64326b3cd5a3b5588ec8a', 'request_id': 'req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:48.497570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] The token cache is being invalidate because project 14a1fdf394b64326b3cd5a3b5588ec8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:48.497863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:48.499547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4dd8b145-5a97-4f03-9370-ba79d2d8e94b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:48.501196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1233/2478] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:48 2022] DELETE /identity/v3/projects/14a1fdf394b64326b3cd5a3b5588ec8a => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:48.509390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089db55-c459-418f-86cd-cc06d2a92d1f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:48.511075 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089db55-c459-418f-86cd-cc06d2a92d1f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:48.511598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d089db55-c459-418f-86cd-cc06d2a92d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:48.536375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d089db55-c459-418f-86cd-cc06d2a92d1f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:48.536608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:48.537299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:48.537699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:48.538102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:48.538679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d089db55-c459-418f-86cd-cc06d2a92d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:48.540243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:48.627892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:48.652587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1234/2479] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:48.666203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:48.667060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:48.667727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:48.710666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:48.712084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:48.717739 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:48.724094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:48.737509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1246/2480] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:48.746905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1235/2481] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:31:48.748054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:48.770772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c29dc30-5969-4539-9524-44dab508386a service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:48.781554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:48.781554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:48.781554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:48.782122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:48.783346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:31:48.783765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:48.791079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:48.817516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1247/2482] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:31:48.822062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:48.837269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167d6b1-207b-43dd-8476-e4bb9f4901fb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:48.854071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:48.854715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:48.855118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:48.855334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:48.856150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:48.858290 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:48.895784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1236/2483] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:48 2022] POST /identity/v3/projects => generated 383 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:48.897205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:48.915403 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0d6950-6164-4fdc-ba26-a20421579cba admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.020458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.021530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.021813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.022201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.022895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.024966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.064404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1248/2484] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:48 2022] POST /identity/v3/users => generated 292 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:49.069056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.081031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f35b84-437b-4152-a6a0-4ff1041b4e8f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.094276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.102020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.102417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.105265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.106183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.109858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.122882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1237/2485] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:49.127104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.154481 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb7ba0-90d3-4bef-962d-39257984c2cf admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.161751 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03015c6e-673e-427f-babd-f4af96831c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.162367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03015c6e-673e-427f-babd-f4af96831c0e admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.162642 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03015c6e-673e-427f-babd-f4af96831c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.163075 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03015c6e-673e-427f-babd-f4af96831c0e admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.163727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03015c6e-673e-427f-babd-f4af96831c0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.165358 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03015c6e-673e-427f-babd-f4af96831c0e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.177401 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1249/2486] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:49.181504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.199454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d77cba3-d3ec-4605-83d5-db537f95f1f2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.206130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.207363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.207724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.208080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] PATH_INFO: `/v3/projects/8edf229060ba4082872e602ebebd8a37/users/585c4a9d2914494795e9dd532fede791/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.227879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8edf229060ba4082872e602ebebd8a37, user_id=585c4a9d2914494795e9dd532fede791, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.231848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.252473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1238/2487] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:49 2022] PUT /identity/v3/projects/8edf229060ba4082872e602ebebd8a37/users/585c4a9d2914494795e9dd532fede791/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:49.264251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.264890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.265169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.299891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] MFA Rules not processed for user `585c4a9d2914494795e9dd532fede791`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:49.301442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:49.395170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1250/2488] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:49.397371 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.472240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c3b27b-b381-40c9-9701-93570b89ae1b admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.476855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.477460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.477742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.478065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.478633 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.480751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.487220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:49.512576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1239/2489] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:49 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:31:49.517034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.528158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab259b4-229e-40a1-bbac-ab44f9f5d8f8 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.557850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:49.586918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.587569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.587848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.588167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.588795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.590694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.613018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1251/2490] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:49 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:49.617306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.628639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b21640-9316-4d90-aa15-7d46ed2dbf8c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.633688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.634289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.634574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.634907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.635557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.637180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.647301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1240/2491] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:49.651864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.663378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0600bdbb-a4f4-4a8e-a3b6-6678e3e8a177 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.667945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a8cdb-0532-4cce-bd90-f1215275063f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.668564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a8cdb-0532-4cce-bd90-f1215275063f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.668845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a8cdb-0532-4cce-bd90-f1215275063f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.669158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a8cdb-0532-4cce-bd90-f1215275063f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.669753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a8cdb-0532-4cce-bd90-f1215275063f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.672294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a8cdb-0532-4cce-bd90-f1215275063f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.681883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1252/2492] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:49.685911 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.695741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85424ef8-fdf6-4a20-8f66-a37bffa1444d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.700247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.700882 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.701262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.701540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] PATH_INFO: `/v3/projects/72089d8bc16e4ae2b40040582a48c4ad/users/20e28ff16d6044629c303cd10c6c43be/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.716351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72089d8bc16e4ae2b40040582a48c4ad, user_id=20e28ff16d6044629c303cd10c6c43be, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.719608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.732142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1241/2493] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:49 2022] PUT /identity/v3/projects/72089d8bc16e4ae2b40040582a48c4ad/users/20e28ff16d6044629c303cd10c6c43be/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:31:49.743137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.743428 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.743706 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.773163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] MFA Rules not processed for user `20e28ff16d6044629c303cd10c6c43be`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:49.774371 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:49.839171 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1253/2494] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:49.844456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.905796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7db2d8d-4777-4445-a733-2e211801ea12 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:49.910688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:49.911363 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:49.911632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:49.911902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:49.912547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:49.914472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:49.942540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1242/2495] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:49 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:49.946622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:49.958145 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e9b416-bb81-4fab-933a-d1fbafc36358 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:50.014336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:50.015238 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.015573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.015847 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.016477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:50.018389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:50.042039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1254/2496] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:49 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:50.046575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:50.057019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0338e1c-83bf-4026-a4a8-50c73ba0d591 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:50.061898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:50.062507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.062823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.063782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.063782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:50.065520 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:50.077996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1243/2497] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:50.082210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:50.093493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8fcc3-f3f4-4ded-bd10-b169ced0a7b2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:50.098530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:50.098884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.099170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.099448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] PATH_INFO: `/v3/projects/a765fc28a3774b309048566823da31f0/users/15ef84675d214d3b99c2cdd4acadf5c1/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.115583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a765fc28a3774b309048566823da31f0, user_id=15ef84675d214d3b99c2cdd4acadf5c1, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:50.118260 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:50.133293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1255/2498] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:50 2022] PUT /identity/v3/projects/a765fc28a3774b309048566823da31f0/users/15ef84675d214d3b99c2cdd4acadf5c1/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:31:50.137429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:50.150100 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71018bc0-67ae-427d-a06a-cc599829b8c7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:50.226084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fb45e0-c62c-4582-8bab-7538e0697a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:50.226741 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb45e0-c62c-4582-8bab-7538e0697a1a admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.227053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb45e0-c62c-4582-8bab-7538e0697a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.227300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb45e0-c62c-4582-8bab-7538e0697a1a admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.228021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb45e0-c62c-4582-8bab-7538e0697a1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:50.229580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fb45e0-c62c-4582-8bab-7538e0697a1a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:50.241645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1244/2499] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:50.243548 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:50.250175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:50.254144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec49ada7-7cee-48b4-a69d-690b9fafc705 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:50.259894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:50.260558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.260844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.261126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] PATH_INFO: `/v3/projects/a765fc28a3774b309048566823da31f0/users/15ef84675d214d3b99c2cdd4acadf5c1/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.263148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a765fc28a3774b309048566823da31f0, user_id=15ef84675d214d3b99c2cdd4acadf5c1, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:50.266517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:50.276954 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1256/2500] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:50 2022] PUT /identity/v3/projects/a765fc28a3774b309048566823da31f0/users/15ef84675d214d3b99c2cdd4acadf5c1/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:50.288325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.288832 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.289303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.316667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] MFA Rules not processed for user `15ef84675d214d3b99c2cdd4acadf5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:50.317898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:50.327952 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:50.389729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1245/2501] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:50 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:50.401459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:50.403274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:50.461249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123ac581-c2d9-4592-89f6-ff532aafa52e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:50.464909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:50.465511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:50.465797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:50.466076 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:50.520584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:50.521947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:50.531534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1257/2502] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:50 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:52.037258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:52.039504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:52.052667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44cb1ee-5753-4b53-bd62-7d52e6bcb838 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:52.057674 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dce47e-5fe3-4a1d-ad3e-db162ae95970 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:52.058291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce47e-5fe3-4a1d-ad3e-db162ae95970 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:52.058576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce47e-5fe3-4a1d-ad3e-db162ae95970 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:52.058898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dce47e-5fe3-4a1d-ad3e-db162ae95970 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:52.117930 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce47e-5fe3-4a1d-ad3e-db162ae95970 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:52.119325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dce47e-5fe3-4a1d-ad3e-db162ae95970 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:52.128692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1246/2503] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:52 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:52.669144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:52.678413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef9c63-d41e-408c-84ce-d38e016a15ab service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:52.681946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b3e339-367a-4ccb-97e6-2cb11360e250 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:52.682537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3e339-367a-4ccb-97e6-2cb11360e250 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:52.682852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3e339-367a-4ccb-97e6-2cb11360e250 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:52.683123 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b3e339-367a-4ccb-97e6-2cb11360e250 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:52.691917 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3e339-367a-4ccb-97e6-2cb11360e250 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:52.693336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b3e339-367a-4ccb-97e6-2cb11360e250 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:52.703214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1258/2504] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:54.913445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84b1f-0e99-4f96-9595-bb4ec898cac4 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:54.913980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84b1f-0e99-4f96-9595-bb4ec898cac4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:54.913980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee84b1f-0e99-4f96-9595-bb4ec898cac4 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:54.915584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1247/2505] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:31:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:31:54.922866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a1149-6774-4093-9f58-d6033d52532a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:54.923388 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a1149-6774-4093-9f58-d6033d52532a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:54.923549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a1149-6774-4093-9f58-d6033d52532a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:54.957366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-329a1149-6774-4093-9f58-d6033d52532a None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:54.958951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-329a1149-6774-4093-9f58-d6033d52532a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:55.055961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1259/2506] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:31:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:55.068009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84b1f-0e99-4f96-9595-bb4ec898cac4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:55.070556 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-aee84b1f-0e99-4f96-9595-bb4ec898cac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:55.127830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee84b1f-0e99-4f96-9595-bb4ec898cac4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:55.131383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2323b50-e495-4f8d-9b10-347d8e191a2d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:55.131978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323b50-e495-4f8d-9b10-347d8e191a2d service glance] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.132254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323b50-e495-4f8d-9b10-347d8e191a2d service glance] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.132524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323b50-e495-4f8d-9b10-347d8e191a2d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.142517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2323b50-e495-4f8d-9b10-347d8e191a2d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:55.143965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2323b50-e495-4f8d-9b10-347d8e191a2d service glance] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:55.155332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1248/2507] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:55.224911 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57fe3-fd2b-4ed1-8140-5e59f4b77166 None None] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.225210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57fe3-fd2b-4ed1-8140-5e59f4b77166 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.225493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb57fe3-fd2b-4ed1-8140-5e59f4b77166 None None] PATH_INFO: `/` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.227008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1260/2508] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:31:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:31:55.231582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272d6bc-1804-4141-9f5c-308e5ff26796 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.231939 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272d6bc-1804-4141-9f5c-308e5ff26796 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.232978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c272d6bc-1804-4141-9f5c-308e5ff26796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.254970 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-c272d6bc-1804-4141-9f5c-308e5ff26796 None None] MFA Rules not processed for user `b2ddc26aee434b5d954cb42d979df7a2`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:55.256210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c272d6bc-1804-4141-9f5c-308e5ff26796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:55.311758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:55.320466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1249/2509] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:31:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:31:55.334023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57fe3-fd2b-4ed1-8140-5e59f4b77166 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:55.336310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-cbb57fe3-fd2b-4ed1-8140-5e59f4b77166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:55.350903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb57fe3-fd2b-4ed1-8140-5e59f4b77166 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:55.354882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e5db78-9ba9-44cd-b1ab-9d7f23734efa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:55.355117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5db78-9ba9-44cd-b1ab-9d7f23734efa service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.355402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5db78-9ba9-44cd-b1ab-9d7f23734efa service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.355736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e5db78-9ba9-44cd-b1ab-9d7f23734efa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.363287 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5db78-9ba9-44cd-b1ab-9d7f23734efa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:55.364718 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e5db78-9ba9-44cd-b1ab-9d7f23734efa service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:55.373091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1261/2510] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:55.472056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254ed09-17e9-4ab9-9033-40acb391e299 None None] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.472800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254ed09-17e9-4ab9-9033-40acb391e299 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.473159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1254ed09-17e9-4ab9-9033-40acb391e299 None None] PATH_INFO: `/` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.474858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1250/2511] 10.222.0.39 () {54 vars in 921 bytes} [Wed Aug 17 23:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 17 23:31:55.480812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.481414 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.481703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.502855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] MFA Rules not processed for user `8ba4d7dcfc6248118c0100c91a8e0236`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:55.504928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:55.524459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1262/2512] 10.222.0.39 () {58 vars in 1018 bytes} [Wed Aug 17 23:31:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:31:55.530387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254ed09-17e9-4ab9-9033-40acb391e299 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:55.532218 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1254ed09-17e9-4ab9-9033-40acb391e299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:55.548043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1254ed09-17e9-4ab9-9033-40acb391e299 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:55.552375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda81234-9707-4837-b911-f7f08b73fe98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:55.553108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81234-9707-4837-b911-f7f08b73fe98 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:55.553495 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81234-9707-4837-b911-f7f08b73fe98 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:55.553867 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda81234-9707-4837-b911-f7f08b73fe98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:55.569782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda81234-9707-4837-b911-f7f08b73fe98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:55.572170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda81234-9707-4837-b911-f7f08b73fe98 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:55.588598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1251/2513] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:56.712874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:56.718602 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:56.777424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951ede9-28a5-4f04-addb-8f644b6ac02d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:56.782122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:56.782778 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:56.783070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:56.783346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] PATH_INFO: `/v3/users/585c4a9d2914494795e9dd532fede791` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:56.784448 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] RBAC: Authorizing `identity:delete_user(user_id=585c4a9d2914494795e9dd532fede791)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:56.786378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:56.831249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '585c4a9d2914494795e9dd532fede791'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:56.831896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '585c4a9d2914494795e9dd532fede791'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:56.844505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '585c4a9d2914494795e9dd532fede791'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:56.852722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '585c4a9d2914494795e9dd532fede791'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:56.860377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '585c4a9d2914494795e9dd532fede791'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:56.866243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1263/2514] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:56 2022] DELETE /identity/v3/users/585c4a9d2914494795e9dd532fede791 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:56.870752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:56.871200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:56.871291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:56.890286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:56.891488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:56.949607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1252/2515] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:56.959349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:56.960806 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:57.017315 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93217486-389b-44ae-80a5-8021b2ff6fad admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:57.020971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:57.021575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:57.021858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:57.022132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:57.031333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:57.032761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:57.041985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1264/2516] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:57.265837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:57.267642 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:57.355793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:57.358330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:57.360632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d4837-cc47-4f68-bbdd-4b2be775754d None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:57.366507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:57.367214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:57.367509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:57.367780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:57.370607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:57.373432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045efce-7bca-4744-a271-d5df27e1ac69 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:57.379273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:57.379990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:57.380347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:57.380794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] PATH_INFO: `/v3/projects/8edf229060ba4082872e602ebebd8a37` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:57.381927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8edf229060ba4082872e602ebebd8a37)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:57.384330 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:57.408848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:57.434889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8edf229060ba4082872e602ebebd8a37', 'request_id': 'req-440d7bcb-bc84-41f3-b333-d5f363bdad10'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.436734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:57.438018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:57.441451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8edf229060ba4082872e602ebebd8a37', 'request_id': 'req-440d7bcb-bc84-41f3-b333-d5f363bdad10'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.448307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1253/2517] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:57.449413 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8edf229060ba4082872e602ebebd8a37', 'request_id': 'req-440d7bcb-bc84-41f3-b333-d5f363bdad10'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.461077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] The token cache is being invalidate because project 8edf229060ba4082872e602ebebd8a37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:57.461229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.461867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.463439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1265/2518] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:57 2022] DELETE /identity/v3/projects/8edf229060ba4082872e602ebebd8a37 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:31:57.468252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:57.479051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4ff611-844e-412a-bc10-c788c2483e99 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:57.497843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:57.537181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:57.537811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:57.538092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:57.538361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] PATH_INFO: `/v3/users/20e28ff16d6044629c303cd10c6c43be` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:57.539537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=20e28ff16d6044629c303cd10c6c43be)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:57.541449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:57.591236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20e28ff16d6044629c303cd10c6c43be'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.603519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20e28ff16d6044629c303cd10c6c43be'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.612213 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20e28ff16d6044629c303cd10c6c43be'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.613027 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20e28ff16d6044629c303cd10c6c43be'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.621194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20e28ff16d6044629c303cd10c6c43be'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:57.628266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1254/2519] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:57 2022] DELETE /identity/v3/users/20e28ff16d6044629c303cd10c6c43be => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:31:57.914624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:57.916868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:57.931132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d7bcb-bc84-41f3-b333-d5f363bdad10 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:57.987935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:57.988502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:57.988786 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:57.989063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] PATH_INFO: `/v3/projects/72089d8bc16e4ae2b40040582a48c4ad` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:57.990175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72089d8bc16e4ae2b40040582a48c4ad)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:57.992153 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:58.043019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72089d8bc16e4ae2b40040582a48c4ad', 'request_id': 'req-26e660bb-b274-4e4d-bc62-078927450920'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.049782 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72089d8bc16e4ae2b40040582a48c4ad', 'request_id': 'req-26e660bb-b274-4e4d-bc62-078927450920'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.059006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72089d8bc16e4ae2b40040582a48c4ad', 'request_id': 'req-26e660bb-b274-4e4d-bc62-078927450920'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.071025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] The token cache is being invalidate because project 72089d8bc16e4ae2b40040582a48c4ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:58.071313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.071961 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.073447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1266/2520] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:57 2022] DELETE /identity/v3/projects/72089d8bc16e4ae2b40040582a48c4ad => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:58.077679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:58.079183 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:58.093164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a408a828-2c1e-4f5a-8ce4-9296a4e70dbd admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:58.151611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:58.152263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:58.152544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:58.152820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] PATH_INFO: `/v3/users/15ef84675d214d3b99c2cdd4acadf5c1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:58.154544 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ef84675d214d3b99c2cdd4acadf5c1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:58.156661 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:58.204998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:58.208467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ef84675d214d3b99c2cdd4acadf5c1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.226285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ef84675d214d3b99c2cdd4acadf5c1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.235776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ef84675d214d3b99c2cdd4acadf5c1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.236858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ef84675d214d3b99c2cdd4acadf5c1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.245162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bb73e93a-d823-4858-971f-53c6d5fc114e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ef84675d214d3b99c2cdd4acadf5c1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.252384 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1255/2521] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:31:58 2022] DELETE /identity/v3/users/15ef84675d214d3b99c2cdd4acadf5c1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:58.643694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:58.646384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:58.693666 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e660bb-b274-4e4d-bc62-078927450920 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:58.758309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:58.791630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:58.793130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:58.793526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:58.793870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] PATH_INFO: `/v3/projects/a765fc28a3774b309048566823da31f0` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:58.795732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a765fc28a3774b309048566823da31f0)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:58.799170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:58.880384 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a765fc28a3774b309048566823da31f0', 'request_id': 'req-1acf0eb7-fd18-4552-bc54-765b3174df5f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.886960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a765fc28a3774b309048566823da31f0', 'request_id': 'req-1acf0eb7-fd18-4552-bc54-765b3174df5f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.895607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a765fc28a3774b309048566823da31f0', 'request_id': 'req-1acf0eb7-fd18-4552-bc54-765b3174df5f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.910035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] The token cache is being invalidate because project a765fc28a3774b309048566823da31f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:31:58.910423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.911170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1acf0eb7-fd18-4552-bc54-765b3174df5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:31:58.912737 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1267/2522] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:31:58 2022] DELETE /identity/v3/projects/a765fc28a3774b309048566823da31f0 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:58.918325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:58.918762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:58.919111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:58.941151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:58.942459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:59.022275 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1256/2523] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:31:59.023946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.024387 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.024536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.045781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:59.047165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:59.059720 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1268/2524] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:59.060966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.071727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d351a-b0d1-4dec-8905-53bd47d553d0 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.076964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.077781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.078322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.078410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.079099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:31:59.079408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.081012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.093528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1257/2525] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:31:59.098022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.108570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0f00-d902-4a09-b2cc-694e807f25e5 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.113734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.114432 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.114818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.115550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.115880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.117909 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.156703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1269/2526] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:31:59 2022] POST /identity/v3/projects => generated 365 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:31:59.157920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.174474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8144c43-252e-4f80-a9ba-83a40ec3efaa admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.249690 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.250447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.250943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.251295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.252006 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.254282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.291360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1258/2527] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:31:59 2022] POST /identity/v3/users => generated 283 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:31:59.296488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.309589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9705897-0535-48f4-8a72-49a160207ec0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.316527 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.317324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.317715 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.318090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.318882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.320807 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.334780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1270/2528] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:59.338906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.350609 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509ca0cd-d61d-4b41-863c-3fdcab24299a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.356696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f2945b-4262-4fe0-89a2-41c0ad61f0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.358085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2945b-4262-4fe0-89a2-41c0ad61f0d5 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.358417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2945b-4262-4fe0-89a2-41c0ad61f0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.358806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f2945b-4262-4fe0-89a2-41c0ad61f0d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.359490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2945b-4262-4fe0-89a2-41c0ad61f0d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.361108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f2945b-4262-4fe0-89a2-41c0ad61f0d5 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.376480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1259/2529] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:31:59.377688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.388022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366d462-665e-468f-8e80-44c45c43c0a3 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.393687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.394013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.394296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.394573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] PATH_INFO: `/v3/projects/858b23e24a2646e281b49efa5ef5ed2e/users/0e395b8e776343529e97212e1d7b2b84/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.412079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=858b23e24a2646e281b49efa5ef5ed2e, user_id=0e395b8e776343529e97212e1d7b2b84, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.414871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.432848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1271/2530] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:31:59 2022] PUT /identity/v3/projects/858b23e24a2646e281b49efa5ef5ed2e/users/0e395b8e776343529e97212e1d7b2b84/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:31:59.443827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb219-379d-46aa-8117-6a67bda8153d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.447343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb219-379d-46aa-8117-6a67bda8153d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.447906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748fb219-379d-46aa-8117-6a67bda8153d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.519942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-748fb219-379d-46aa-8117-6a67bda8153d None None] MFA Rules not processed for user `0e395b8e776343529e97212e1d7b2b84`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:59.521786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-748fb219-379d-46aa-8117-6a67bda8153d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:59.539475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:59.630117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1260/2531] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:31:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:59.642557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.644376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:59.729543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5cd2f-5614-4adb-8927-d6ef3af28c39 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:31:59.734166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:31:59.734829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.735116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.735395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.745411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:31:59.747160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:31:59.758207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1272/2532] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:31:59 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:31:59.780756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:31:59.781219 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:31:59.781564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:31:59.802683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:31:59.803922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:59.870868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1261/2533] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:31:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:31:59.885181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:31:59.886304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:31:59.901447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:31:59.996643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6842bd27-6485-4780-afaa-ec111ce913a5 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:00.003072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:00.003918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:00.004273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:00.004665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:00.018445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:00.021693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:00.036335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1273/2534] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:31:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:32:05.743051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:05.745127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:05.759016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83156bc8-62d1-48d6-96b2-a9f86241b7f4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:05.786963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:05.788050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:05.788601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:05.788896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:05.792136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:05.935571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:05.937689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:05.968046 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1262/2535] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:06.108503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:06.110613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:06.185326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28518bc3-e69a-4f12-bb1f-9a939fd0214c service swift] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:06.189606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:06.190224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:06.190657 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:06.191043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:06.192987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:06.282968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:06.284327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:06.298160 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1274/2536] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:09.896007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:09.897486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:09.917002 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72a52-935a-4946-a692-1b85e5fdcb13 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:09.922353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:09.923079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:09.923367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:09.923644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] PATH_INFO: `/v3/users/31b0201bf57647b1b71e0a7bc592bf3a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:09.924785 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b0201bf57647b1b71e0a7bc592bf3a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:09.928380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:09.978064 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b0201bf57647b1b71e0a7bc592bf3a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:09.984015 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:09.992487 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b0201bf57647b1b71e0a7bc592bf3a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:09.999886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b0201bf57647b1b71e0a7bc592bf3a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.000517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b0201bf57647b1b71e0a7bc592bf3a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.007480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-05d00655-19fd-4e0b-be23-b46c07b31a13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b0201bf57647b1b71e0a7bc592bf3a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.013382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1263/2537] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:32:09 2022] DELETE /identity/v3/users/31b0201bf57647b1b71e0a7bc592bf3a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:10.205505 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.218136 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847affe-8ee8-407c-877e-3bec1bc7bce7 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.272926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:10.297015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.298454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.298744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.299235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] PATH_INFO: `/v3/projects/451c0e36ddac4bb5b6e50a5f61995777` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.300979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] RBAC: Authorizing `identity:delete_project(project_id=451c0e36ddac4bb5b6e50a5f61995777)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.302988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.364863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '451c0e36ddac4bb5b6e50a5f61995777', 'request_id': 'req-a0d52b99-1589-47f1-b351-2e364073a513'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.370503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '451c0e36ddac4bb5b6e50a5f61995777', 'request_id': 'req-a0d52b99-1589-47f1-b351-2e364073a513'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.379441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '451c0e36ddac4bb5b6e50a5f61995777', 'request_id': 'req-a0d52b99-1589-47f1-b351-2e364073a513'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.393390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] The token cache is being invalidate because project 451c0e36ddac4bb5b6e50a5f61995777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:32:10.393818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.394526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a0d52b99-1589-47f1-b351-2e364073a513 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:10.396117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1275/2538] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:32:10 2022] DELETE /identity/v3/projects/451c0e36ddac4bb5b6e50a5f61995777 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:10.401754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.402043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.402365 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.424640 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:10.425950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:10.490960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1264/2539] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:10.499409 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.499757 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.500040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.520307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:10.521524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:10.529949 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1276/2540] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:32:10.534321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.544103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0365d4-3fd8-4fa3-9525-1577aa6a0d30 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.549210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.549806 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.550087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.550361 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.551057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:32:10.551360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.552972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.565120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1265/2541] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:32:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:32:10.569485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.579202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3bd9b0-2b73-4fff-8e48-f3256d9ae789 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.583760 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.584350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.584631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.584903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.585530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.587460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.615040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1277/2542] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:32:10 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:32:10.619301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.630144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4215c-a306-4a5f-baaa-0c16f7012091 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.686848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.687454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.687736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.688009 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.688629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.690562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.712400 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1266/2543] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:32:10 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:32:10.717074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.727334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05188bed-e514-49da-b1f0-184fc1dab428 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.731942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.733066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.733338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.733613 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.734256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.735879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.745493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1278/2544] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:32:10.749278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.759137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db30ecd-05bd-4310-aebc-8ef1d0a178b1 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.763896 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3496706-2ae2-48e7-a029-537a8f353908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.764492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496706-2ae2-48e7-a029-537a8f353908 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.764777 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496706-2ae2-48e7-a029-537a8f353908 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.765047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3496706-2ae2-48e7-a029-537a8f353908 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.765775 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3496706-2ae2-48e7-a029-537a8f353908 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.767456 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3496706-2ae2-48e7-a029-537a8f353908 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.778360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1267/2545] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:32:10.782827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.792716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7892780b-61ef-4c91-9f61-730ade573ec2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.797966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.798616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.798939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.799219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] PATH_INFO: `/v3/projects/0e9f5b5cb89d48528096cee8088f673c/users/135b1d2592964d0eb7327e4a64618774/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.813350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e9f5b5cb89d48528096cee8088f673c, user_id=135b1d2592964d0eb7327e4a64618774, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:10.816060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:10.828547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1279/2546] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:32:10 2022] PUT /identity/v3/projects/0e9f5b5cb89d48528096cee8088f673c/users/135b1d2592964d0eb7327e4a64618774/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:10.833445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781e2b-3359-467e-b984-35cbfe8c0db8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.833729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781e2b-3359-467e-b984-35cbfe8c0db8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.834005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73781e2b-3359-467e-b984-35cbfe8c0db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:10.853162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-73781e2b-3359-467e-b984-35cbfe8c0db8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:10.854382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-73781e2b-3359-467e-b984-35cbfe8c0db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:10.891909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:10.921297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1268/2547] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:10.931014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:10.932929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:10.989722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205fa2c-8472-4d37-b820-606a1a7f7b41 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:10.993391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:10.993993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:10.994275 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:10.994551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:11.004236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:11.005831 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:11.015389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1280/2548] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:15.542138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f72b7-d1a6-44c0-a310-d62537b1d0e4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:15.542696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f72b7-d1a6-44c0-a310-d62537b1d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:15.542696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222f72b7-d1a6-44c0-a310-d62537b1d0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:15.568382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-222f72b7-d1a6-44c0-a310-d62537b1d0e4 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:15.571632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-222f72b7-d1a6-44c0-a310-d62537b1d0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:15.661019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1269/2549] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 17 23:32:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:15.681083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:15.683039 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:15.711024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:15.790918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03711433-240f-43f7-8a83-d95929ebf061 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:15.798267 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:15.799186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:15.799836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:15.799974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:15.812533 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:15.814236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:15.823633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1281/2550] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:32:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:32:16.168426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62ac4-6aa9-4afe-9403-8731f2eb5563 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:16.168712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62ac4-6aa9-4afe-9403-8731f2eb5563 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:16.169178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e62ac4-6aa9-4afe-9403-8731f2eb5563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:16.206193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-05e62ac4-6aa9-4afe-9403-8731f2eb5563 None None] MFA Rules not processed for user `135b1d2592964d0eb7327e4a64618774`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:16.207809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-05e62ac4-6aa9-4afe-9403-8731f2eb5563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:16.301094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1270/2551] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:16 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:16.316410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:16.318066 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:16.411562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5e7fe6-4364-4f01-bec3-926c5f106665 service swift] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:16.417480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:16.418113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:16.418404 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:16.418693 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:16.427913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:16.429524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:16.439472 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1282/2552] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:17.846523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:17.847082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:17.847337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:17.869856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] MFA Rules not processed for user `135b1d2592964d0eb7327e4a64618774`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:17.871130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:17.879079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1271/2553] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:18.213389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:18.223474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e4a4f8-2057-435b-9616-600e379638a9 service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:18.227299 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:18.227903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:18.228185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:18.228454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:18.230165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:18.242174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:18.243665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:18.254888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1283/2554] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:18.660762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:18.663214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:18.751292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4a3afb-1c15-41b4-9d2a-823f612f47fd None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:18.757131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757873a4-b337-46c9-8461-631a972709ec service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:18.757755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757873a4-b337-46c9-8461-631a972709ec service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:18.758035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757873a4-b337-46c9-8461-631a972709ec service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:18.758312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757873a4-b337-46c9-8461-631a972709ec service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:18.760099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-757873a4-b337-46c9-8461-631a972709ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:18.770669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:18.773778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757873a4-b337-46c9-8461-631a972709ec service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:18.778820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757873a4-b337-46c9-8461-631a972709ec service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:18.790293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1272/2555] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:20.692825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:20.694555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:20.705945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcff9cf-df4c-4a95-838f-759b49388ca7 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:20.710304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:20.710975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:20.711296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:20.711534 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:20.714207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:20.725725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:20.727259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:20.737367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1284/2556] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:28.786226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:29.241820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757873a4-b337-46c9-8461-631a972709ec service placement] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:29.243273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-757873a4-b337-46c9-8461-631a972709ec service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:29.258875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757873a4-b337-46c9-8461-631a972709ec service placement] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:29.264321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:29.264927 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:29.265210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:29.265486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:29.267225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:29.284627 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:29.286343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f5455-3d6a-4781-9dad-151aa47c1fe2 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:29.298004 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1273/2557] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:30.732113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=70 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:30.990385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:30.991808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:31.005888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e338df-34ad-428a-aee6-6581f82659a5 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.010361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.011007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.011288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.011570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] PATH_INFO: `/v3/users/0e395b8e776343529e97212e1d7b2b84` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.012695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e395b8e776343529e97212e1d7b2b84)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.014598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:31.060184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e395b8e776343529e97212e1d7b2b84'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.060843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e395b8e776343529e97212e1d7b2b84'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.073309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e395b8e776343529e97212e1d7b2b84'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.081427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e395b8e776343529e97212e1d7b2b84'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.088325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e395b8e776343529e97212e1d7b2b84'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.101919 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1285/2558] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:32:30 2022] DELETE /identity/v3/users/0e395b8e776343529e97212e1d7b2b84 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:31.106388 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.106893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.106989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.125830 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:31.127768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:31.185588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1274/2559] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:31.195971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:31.197368 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:31.255946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c22b9e1-d8ed-4ae1-98ac-1d6fcc3fcd63 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.259525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df53178-0e70-4a01-9684-715c098baa2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.260126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df53178-0e70-4a01-9684-715c098baa2e service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.260429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df53178-0e70-4a01-9684-715c098baa2e service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.260685 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df53178-0e70-4a01-9684-715c098baa2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.270057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df53178-0e70-4a01-9684-715c098baa2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.271544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df53178-0e70-4a01-9684-715c098baa2e service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:31.282183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1286/2560] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:31.551964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:31.553415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:31.568347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c580ce-bd34-4268-a70f-9e476bed9f6f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.573293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.573938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.574225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.574501 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] PATH_INFO: `/v3/projects/858b23e24a2646e281b49efa5ef5ed2e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.575678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=858b23e24a2646e281b49efa5ef5ed2e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.577618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:31.625780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '858b23e24a2646e281b49efa5ef5ed2e', 'request_id': 'req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.631352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '858b23e24a2646e281b49efa5ef5ed2e', 'request_id': 'req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.638334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '858b23e24a2646e281b49efa5ef5ed2e', 'request_id': 'req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.649425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] The token cache is being invalidate because project 858b23e24a2646e281b49efa5ef5ed2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:32:31.649722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.650409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-e9d586ee-6117-4d1d-8eeb-a876cdae7e49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:31.652171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1275/2561] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:32:31 2022] DELETE /identity/v3/projects/858b23e24a2646e281b49efa5ef5ed2e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:31.656888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.657177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.657473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.677897 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:31.679146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:31.737913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1287/2562] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:31.745475 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.745768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.746032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.765780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:31.767003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:31.775451 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1276/2563] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:31.779863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:31.789674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c95d869-92e0-4bf4-bc10-3de161316754 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.794359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.794929 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.795216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.795490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.796140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:32:31.796459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.798056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:31.809762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1288/2564] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:32:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:32:31.813943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:31.823695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a54a8-6ce0-46e2-9f79-6161d45566d4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.828297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.828879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.829156 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.829426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.830608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.832526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:31.858591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1277/2565] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:32:31 2022] POST /identity/v3/projects => generated 391 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:32:31.863261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:31.868457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:31.880483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e1152-1797-4dfc-8970-2c1ea09d976b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.942422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.943087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.943557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.944056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.945195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.949668 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:31.971623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1289/2566] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:32:31 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:32:31.975680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:31.986029 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc54dc3-0c3f-48a8-8198-b08b9058080a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:31.991185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:31.991779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:31.992060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:31.992372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:31.993089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:31.994889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:32.005503 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1278/2567] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:32:31 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:32:32.009271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:32.019211 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55881f61-f477-4178-bba0-1899c76dbcb3 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:32.023771 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7de73e-3bb2-4569-88cd-77aee5f33d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:32.024361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7de73e-3bb2-4569-88cd-77aee5f33d43 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:32.024646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7de73e-3bb2-4569-88cd-77aee5f33d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:32.024922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7de73e-3bb2-4569-88cd-77aee5f33d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:32.025562 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7de73e-3bb2-4569-88cd-77aee5f33d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:32.027457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7de73e-3bb2-4569-88cd-77aee5f33d43 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:32.037820 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1290/2568] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:32:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:32:32.041893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:32.052558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcb803-7d70-434f-8a37-61351b973c08 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:32.057073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:32.057716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:32.057998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:32.058274 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] PATH_INFO: `/v3/projects/4b32c0651d0f40f8ac0b5e85c32d5f93/users/f8cfd13e705648eebab76d4b01681120/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:32.073497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b32c0651d0f40f8ac0b5e85c32d5f93, user_id=f8cfd13e705648eebab76d4b01681120, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:32.076194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:32.089395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1279/2569] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:32:32 2022] PUT /identity/v3/projects/4b32c0651d0f40f8ac0b5e85c32d5f93/users/f8cfd13e705648eebab76d4b01681120/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:32.099937 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:32.100273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:32.100555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:32.128816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] MFA Rules not processed for user `f8cfd13e705648eebab76d4b01681120`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:32.130073 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:32.193522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1291/2570] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:32 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:32.204375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:32.206093 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:32.215689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:32.265669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c1f9a-051e-4eeb-a8a3-bff2932ecb03 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:32.269581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecff58f-2e99-4398-8def-76771036dfac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:32.270185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecff58f-2e99-4398-8def-76771036dfac service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:32.270465 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecff58f-2e99-4398-8def-76771036dfac service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:32.270765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecff58f-2e99-4398-8def-76771036dfac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:32.279678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecff58f-2e99-4398-8def-76771036dfac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:32.281116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecff58f-2e99-4398-8def-76771036dfac service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:32.291142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1280/2571] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:42.190538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:42.287509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=23 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:42.410058 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:42.471930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfd731-6ccf-45b9-8d03-7ffad690700e None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:42.476568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:42.477194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:42.477477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:42.477755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] PATH_INFO: `/v3/users/f8cfd13e705648eebab76d4b01681120` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:42.478902 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8cfd13e705648eebab76d4b01681120)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:42.480832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:42.525985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8cfd13e705648eebab76d4b01681120'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:42.526928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8cfd13e705648eebab76d4b01681120'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:42.539203 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8cfd13e705648eebab76d4b01681120'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:42.546349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8cfd13e705648eebab76d4b01681120'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:42.553307 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8cfd13e705648eebab76d4b01681120'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:42.559158 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1292/2572] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:32:42 2022] DELETE /identity/v3/users/f8cfd13e705648eebab76d4b01681120 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:42.563607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:42.563903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:42.564188 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:42.583573 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:32:42.584769 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:42.643731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1281/2573] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:32:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:32:42.653607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:42.655023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:42.713372 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8feae-2807-4a03-9267-81aed5a5be12 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:42.717086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:42.717694 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:42.718000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:42.718256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:42.727380 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:42.728804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:42.738513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1293/2574] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:43.009376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:43.011037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:43.023196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e78de5-4e65-48a3-b402-efe7ab8a116e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:43.028096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:43.028735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:43.029016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:43.029294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] PATH_INFO: `/v3/projects/4b32c0651d0f40f8ac0b5e85c32d5f93` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:43.030419 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b32c0651d0f40f8ac0b5e85c32d5f93)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:43.032473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:43.079788 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b32c0651d0f40f8ac0b5e85c32d5f93', 'request_id': 'req-d331455e-f09a-4b75-8913-eaee0ab13bd4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:43.085243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b32c0651d0f40f8ac0b5e85c32d5f93', 'request_id': 'req-d331455e-f09a-4b75-8913-eaee0ab13bd4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:43.093177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b32c0651d0f40f8ac0b5e85c32d5f93', 'request_id': 'req-d331455e-f09a-4b75-8913-eaee0ab13bd4'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:43.104758 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] The token cache is being invalidate because project 4b32c0651d0f40f8ac0b5e85c32d5f93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:32:43.105051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:43.105694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:32:43.107203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1282/2575] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:32:43 2022] DELETE /identity/v3/projects/4b32c0651d0f40f8ac0b5e85c32d5f93 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:32:52.436276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:52.438294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:52.471063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:52.552193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd0d6b6-af2e-4000-9d52-b6958c15038a service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:52.650593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:52.651342 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:52.651972 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:52.652312 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:52.654137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:52.667668 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:52.669116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:52.682167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1294/2576] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:32:53.101745 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:32:56.669528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:32:56.670999 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:56.728268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d331455e-f09a-4b75-8913-eaee0ab13bd4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:32:56.731901 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:32:56.732505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:32:56.733053 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:32:56.733330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:32:56.735088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:32:56.796648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:32:56.798088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:32:56.808126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1283/2577] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:00.010511 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.012089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:00.028714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6362254-69c5-4584-b165-6d45bf755826 service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.034239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.034940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.035276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.035558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] PATH_INFO: `/v3/users/c7e73f3bfbcd41b29dc41bbbd218d413` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.036736 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7e73f3bfbcd41b29dc41bbbd218d413)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.038731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.093146 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7e73f3bfbcd41b29dc41bbbd218d413'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.093844 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7e73f3bfbcd41b29dc41bbbd218d413'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.110374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7e73f3bfbcd41b29dc41bbbd218d413'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.121721 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7e73f3bfbcd41b29dc41bbbd218d413'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.133769 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-ad0f5c8d-411b-40f4-9d78-cd73d52cadfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7e73f3bfbcd41b29dc41bbbd218d413'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.141215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1295/2578] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:00 2022] DELETE /identity/v3/users/c7e73f3bfbcd41b29dc41bbbd218d413 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:00.331781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.343671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de6a66-83bf-46b3-bd52-3eb21bb9a61e service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.412510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.413236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.413523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.413798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] PATH_INFO: `/v3/projects/b26992e81f65443bad90af4661ae413d` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.415007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b26992e81f65443bad90af4661ae413d)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.416948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.482033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b26992e81f65443bad90af4661ae413d', 'request_id': 'req-f7dce59e-1f16-4305-96c5-92aee050d1e8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.484413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:00.489868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b26992e81f65443bad90af4661ae413d', 'request_id': 'req-f7dce59e-1f16-4305-96c5-92aee050d1e8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.499229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b26992e81f65443bad90af4661ae413d', 'request_id': 'req-f7dce59e-1f16-4305-96c5-92aee050d1e8'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.514130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] The token cache is being invalidate because project b26992e81f65443bad90af4661ae413d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:00.514490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.515126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f7dce59e-1f16-4305-96c5-92aee050d1e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:00.516961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1284/2579] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:00 2022] DELETE /identity/v3/projects/b26992e81f65443bad90af4661ae413d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:00.522060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.522576 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.523103 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.547851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:00.549888 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:00.573249 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:00.636770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1296/2580] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:00.645482 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.645780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.646060 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.669095 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:00.670328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:00.680989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1285/2581] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:00.685688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.696616 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfe272e-07af-40a6-a69f-c29c335190e4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.702722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.703473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.703862 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.704998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.705629 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:33:00.706042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.708325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.727040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1297/2582] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:33:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:33:00.728234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.738565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e805e-342f-4d55-a7bf-0e9d61f0c274 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.743435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.744041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.744319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.744591 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.745214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.747141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.784158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1286/2583] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:00 2022] POST /identity/v3/projects => generated 367 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:00.785398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.795990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256fa6c9-59e6-4b8c-abda-22ea85724f51 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.857557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.858175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.858460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.858795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.859466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.861552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.883259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1298/2584] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:00 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:00.887574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.899030 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69bc50a-4765-44e7-a973-d8eaf0504a17 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.903953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.904560 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.904845 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.905123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.905793 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.907479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.919096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1287/2585] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:00.923357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.933817 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24f25f4-45c0-4d69-a906-1800eea5e43a admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.938400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6efbc0-f1ca-4349-b040-84b0b06fd80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.939892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6efbc0-f1ca-4349-b040-84b0b06fd80f admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.940309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6efbc0-f1ca-4349-b040-84b0b06fd80f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.940659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6efbc0-f1ca-4349-b040-84b0b06fd80f admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.941310 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6efbc0-f1ca-4349-b040-84b0b06fd80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.942928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6efbc0-f1ca-4349-b040-84b0b06fd80f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:00.953593 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1299/2586] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:33:00.958282 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:00.968462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692c7b8-6598-45dc-9b00-d95e0025e835 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:00.973838 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:00.974572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:00.974950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:00.975296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] PATH_INFO: `/v3/projects/dac974d722d848008c1213cae67dd2d9/users/d9ecf532079942e5bdf65f2800f0999f/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:00.990386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac974d722d848008c1213cae67dd2d9, user_id=d9ecf532079942e5bdf65f2800f0999f, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:00.993163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:01.008360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1288/2587] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:00 2022] PUT /identity/v3/projects/dac974d722d848008c1213cae67dd2d9/users/d9ecf532079942e5bdf65f2800f0999f/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:01.020605 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:01.021114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:01.021231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:01.053690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] MFA Rules not processed for user `d9ecf532079942e5bdf65f2800f0999f`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:01.054991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:01.125437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1300/2588] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:01.137271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:01.139171 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:01.199796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba3f1e-f72a-4a5a-887d-601d00e6bab1 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:01.203351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:01.203961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:01.204239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:01.204714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:01.214170 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:01.215702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:01.225286 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1289/2589] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:04.371710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:04.373348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:04.397314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:04.446925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ee1763-710e-4dad-ac94-05693e0b892d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:04.451090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:04.451878 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:04.452183 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:04.452516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:04.454378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:04.516281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:04.517756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85d6f1-bef7-4bc5-81a3-32196d42b7a6 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:04.527640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1301/2590] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:33:09.881267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:09.894799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d64ac-d2ba-486a-97ce-7f3d62a506ea service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:09.899529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:09.900185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:09.900471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:09.900752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] PATH_INFO: `/v3/users/d9ecf532079942e5bdf65f2800f0999f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:09.902201 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ecf532079942e5bdf65f2800f0999f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:09.904428 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:09.967313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ecf532079942e5bdf65f2800f0999f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:09.983813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ecf532079942e5bdf65f2800f0999f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:09.993235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ecf532079942e5bdf65f2800f0999f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:09.993868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ecf532079942e5bdf65f2800f0999f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:09.996851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:10.007112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ecf532079942e5bdf65f2800f0999f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:10.018418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1290/2591] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:09 2022] DELETE /identity/v3/users/d9ecf532079942e5bdf65f2800f0999f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:10.019959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.020431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.020525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.043180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:10.044529 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:10.131961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:10.134334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:10.137367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1302/2592] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:33:10.203665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034f6c1-3b23-4dd2-98c6-1812532c34a6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:10.210312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4581374-bb53-434b-a383-2e17d78a5d76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:10.211098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581374-bb53-434b-a383-2e17d78a5d76 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.211485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581374-bb53-434b-a383-2e17d78a5d76 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.211863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581374-bb53-434b-a383-2e17d78a5d76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.222300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4581374-bb53-434b-a383-2e17d78a5d76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:10.224464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4581374-bb53-434b-a383-2e17d78a5d76 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:10.237376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1291/2593] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:33:10.551125 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:10.552643 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:10.566739 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156fabd2-6b33-4ad3-9579-e3cf6dcd0c64 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:10.571913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:10.572813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.573207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.573581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] PATH_INFO: `/v3/projects/dac974d722d848008c1213cae67dd2d9` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.574901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac974d722d848008c1213cae67dd2d9)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:10.576940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:10.629774 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac974d722d848008c1213cae67dd2d9', 'request_id': 'req-442f936a-2b7e-4a20-a97f-59e7beb67c8d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:10.635426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac974d722d848008c1213cae67dd2d9', 'request_id': 'req-442f936a-2b7e-4a20-a97f-59e7beb67c8d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:10.637319 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:10.644244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac974d722d848008c1213cae67dd2d9', 'request_id': 'req-442f936a-2b7e-4a20-a97f-59e7beb67c8d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:10.657151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] The token cache is being invalidate because project dac974d722d848008c1213cae67dd2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:10.658196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:10.658893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-442f936a-2b7e-4a20-a97f-59e7beb67c8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:10.660676 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1303/2594] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:10 2022] DELETE /identity/v3/projects/dac974d722d848008c1213cae67dd2d9 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:10.665558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f8268-6efd-4fdc-bb32-32b3bf33d60f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.665782 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f8268-6efd-4fdc-bb32-32b3bf33d60f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.666063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3f8268-6efd-4fdc-bb32-32b3bf33d60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.687584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3f3f8268-6efd-4fdc-bb32-32b3bf33d60f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:10.689379 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3f3f8268-6efd-4fdc-bb32-32b3bf33d60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:10.702790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.703178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.703559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.734245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] MFA Rules not processed for user `135b1d2592964d0eb7327e4a64618774`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:10.736978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:10.783141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1292/2595] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:10.787390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.787751 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.788034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.806868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1304/2596] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:33:10.809982 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:10.811251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:10.822157 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1293/2597] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:33:10.826107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:10.839071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37bc8b10-60c1-45cc-b4d6-4a0bd2427795 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:10.846079 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:10.846955 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.847327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.847871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.848711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:33:10.849119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:10.851110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:10.871599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1305/2598] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:33:10.875945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:10.887713 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3565b78-0eae-4ec1-bae7-373a0a1de787 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:10.899705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:10.900423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:10.900777 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:10.901059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:10.902178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:10.904261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:10.935597 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1294/2599] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:10 2022] POST /identity/v3/projects => generated 403 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:10.939793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:10.951030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953962f9-8af2-40c5-8596-ba1de8a0466c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:11.012905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:11.013639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.014022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.014366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.015108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:11.017811 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:11.041884 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1306/2600] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:10 2022] POST /identity/v3/users => generated 302 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:11.046285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:11.058577 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ff4bc9-9b81-458e-b15e-7ffeb016e982 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:11.063357 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:11.064162 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.064515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.064856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.065571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:11.067402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:11.078057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1295/2601] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:11.083990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:11.096690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c94832-a6d8-4ea3-858b-0f62c33187ee admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:11.101780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414b15a8-9799-4673-93ab-077d3a710482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:11.102395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b15a8-9799-4673-93ab-077d3a710482 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.102677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b15a8-9799-4673-93ab-077d3a710482 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.102975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414b15a8-9799-4673-93ab-077d3a710482 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.103620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b15a8-9799-4673-93ab-077d3a710482 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:11.105253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414b15a8-9799-4673-93ab-077d3a710482 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:11.119690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1307/2602] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:11.120943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:11.138014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a27edf-d7b2-497f-8829-b6712be7d077 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:11.143975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:11.145280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.145280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.145553 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] PATH_INFO: `/v3/projects/ffcb73a8af784de9a0245dada92565fd/users/3f5072251067403e8cc23d6b8116024a/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.161422 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffcb73a8af784de9a0245dada92565fd, user_id=3f5072251067403e8cc23d6b8116024a, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:11.164102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:11.178779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1296/2603] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:11 2022] PUT /identity/v3/projects/ffcb73a8af784de9a0245dada92565fd/users/3f5072251067403e8cc23d6b8116024a/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:11.187654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.187940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.188215 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.210142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:11.211385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:11.293240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:11.307509 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1308/2604] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:11.323922 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:11.325720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:11.358323 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:11.359827 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:11.379264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:11.408258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14e3fc7-6cad-48e3-8c79-4b84924b14a4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:11.413111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:11.413760 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.414044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.414320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.425429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:11.426243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:11.428933 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faf6ea6-89ab-498d-abf3-b3ed821370f6 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:11.432673 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:11.433292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:11.433573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:11.433848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:11.435644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:11.436852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1297/2605] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:11.454948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:11.456549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00ebbf-89ba-4458-afe1-c315468a0f67 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:11.466496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1309/2606] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:33:12.257989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:12.260163 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:12.292073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99a33a9-4052-40f6-87ee-77e104e6504b service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:12.297836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:12.298934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:12.299623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:12.300112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] PATH_INFO: `/v3/users/ea51bd0d578b41ec8851804fe75dde30` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:12.301534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea51bd0d578b41ec8851804fe75dde30)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:12.303746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:12.378593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea51bd0d578b41ec8851804fe75dde30'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.396012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea51bd0d578b41ec8851804fe75dde30'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.405041 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea51bd0d578b41ec8851804fe75dde30'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.405786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea51bd0d578b41ec8851804fe75dde30'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.415272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea51bd0d578b41ec8851804fe75dde30'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.422562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1298/2607] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:12 2022] DELETE /identity/v3/users/ea51bd0d578b41ec8851804fe75dde30 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:12.503636 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:12.504627 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:12.505114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:12.537068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] MFA Rules not processed for user `3f5072251067403e8cc23d6b8116024a`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:12.538470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:12.648644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:12.650303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:12.672306 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1310/2608] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:12 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:12.673986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:12.676184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:12.760967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77d7366-1b85-439c-b221-cfb3607dacc7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:12.764562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b58624-c3ef-4925-b2f1-f311832b4332 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:12.766433 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:12.767270 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:12.767592 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:12.767900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:12.768538 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:12.769362 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:12.770069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:12.770858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:12.770967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:12.771061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] PATH_INFO: `/v3/projects/3bfd5124295b4fc2a79ef0a89a5af838` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:12.771891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] RBAC: Authorizing `identity:delete_project(project_id=3bfd5124295b4fc2a79ef0a89a5af838)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:12.773920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:12.811451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1311/2609] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:12 2022] POST /identity/v3/projects => generated 403 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:12.814805 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:12.831134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:12.833193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3bfd5124295b4fc2a79ef0a89a5af838', 'request_id': 'req-cd0900ef-5948-46f7-b980-78c8359cd12f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.837242 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:12.847364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3bfd5124295b4fc2a79ef0a89a5af838', 'request_id': 'req-cd0900ef-5948-46f7-b980-78c8359cd12f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.856440 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3bfd5124295b4fc2a79ef0a89a5af838', 'request_id': 'req-cd0900ef-5948-46f7-b980-78c8359cd12f'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.868043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] The token cache is being invalidate because project 3bfd5124295b4fc2a79ef0a89a5af838 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:12.868417 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.869146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:12.870697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1299/2610] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:12 2022] DELETE /identity/v3/projects/3bfd5124295b4fc2a79ef0a89a5af838 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:12.874489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:12.875824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:12.887139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31c0922-59ed-4996-86d8-7fe083e94ce9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:12.942402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0900ef-5948-46f7-b980-78c8359cd12f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:12.945367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:12.946006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:12.946288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:12.946568 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:12.947128 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:12.947254 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:12.947795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:12.948082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:12.948490 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] PATH_INFO: `/v3/users/c470cb11a9cd46a0b1e4938ccb1995f1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:12.949272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:12.949965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] RBAC: Authorizing `identity:delete_user(user_id=c470cb11a9cd46a0b1e4938ccb1995f1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:12.952033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:12.976775 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1312/2611] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:12 2022] POST /identity/v3/users => generated 308 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:33:12.981044 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:12.984561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:12.997738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c64021-e37a-40cf-9d45-6b1be9fddfc8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:13.002449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:13.003087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:13.003374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:13.003659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:13.004313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:13.005916 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:13.006980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c470cb11a9cd46a0b1e4938ccb1995f1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.015841 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1313/2612] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:13.020102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:13.022334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c470cb11a9cd46a0b1e4938ccb1995f1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.030197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dfdca4-ffd5-4144-83db-071727c4c701 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:13.031114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c470cb11a9cd46a0b1e4938ccb1995f1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.031752 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c470cb11a9cd46a0b1e4938ccb1995f1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.035638 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:13.036278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:13.036565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:13.036843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] PATH_INFO: `/v3/projects/b1c3997853ca42d49594cc3067a7804b/users/f9d321b05e2e4c25825c95948e834e1e/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:13.040083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c470cb11a9cd46a0b1e4938ccb1995f1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.046372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1300/2613] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:12 2022] DELETE /identity/v3/users/c470cb11a9cd46a0b1e4938ccb1995f1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:33:13.054100 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3997853ca42d49594cc3067a7804b, user_id=f9d321b05e2e4c25825c95948e834e1e, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:13.056802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:13.071264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1314/2614] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:13 2022] PUT /identity/v3/projects/b1c3997853ca42d49594cc3067a7804b/users/f9d321b05e2e4c25825c95948e834e1e/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:33:13.075129 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:13.076550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:13.158541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:13.164161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373ee704-bf60-4e7f-8881-2c90b097caec admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:13.252364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:13.253193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:13.272336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:13.272986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:13.273280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:13.278432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:13.283835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:13.285969 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:13.291555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13c871-c09d-432a-b9d4-8d5f93927291 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:13.307520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:13.308900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:13.309228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:13.309583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] PATH_INFO: `/v3/projects/957c06d7ec254c649802c5def7cc3ccb` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:13.315923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1301/2615] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:13 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:33:13.316569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=957c06d7ec254c649802c5def7cc3ccb)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:13.318797 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:13.327725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:13.341115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fa2754-4eb2-4c52-839c-f3a940f8e97d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:13.359850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f00e8f-be3d-485c-b69c-767493192e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:13.362336 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00e8f-be3d-485c-b69c-767493192e65 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:13.362891 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00e8f-be3d-485c-b69c-767493192e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:13.363319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f00e8f-be3d-485c-b69c-767493192e65 admin admin] PATH_INFO: `/v3/projects/b1c3997853ca42d49594cc3067a7804b/users/f9d321b05e2e4c25825c95948e834e1e/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:13.371841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00e8f-be3d-485c-b69c-767493192e65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1c3997853ca42d49594cc3067a7804b, user_id=f9d321b05e2e4c25825c95948e834e1e, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:13.374945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f00e8f-be3d-485c-b69c-767493192e65 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:13.396320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1302/2616] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:13 2022] PUT /identity/v3/projects/b1c3997853ca42d49594cc3067a7804b/users/f9d321b05e2e4c25825c95948e834e1e/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:13.436212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '957c06d7ec254c649802c5def7cc3ccb', 'request_id': 'req-13f9c473-601e-476f-93ce-ddb88057cd56'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.445596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '957c06d7ec254c649802c5def7cc3ccb', 'request_id': 'req-13f9c473-601e-476f-93ce-ddb88057cd56'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.455164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '957c06d7ec254c649802c5def7cc3ccb', 'request_id': 'req-13f9c473-601e-476f-93ce-ddb88057cd56'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.464116 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:13.469589 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] The token cache is being invalidate because project 957c06d7ec254c649802c5def7cc3ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:13.471090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.472947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:13.475735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1315/2617] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:13 2022] DELETE /identity/v3/projects/957c06d7ec254c649802c5def7cc3ccb => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:14.217411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:14.217781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:14.218268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:14.257874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] MFA Rules not processed for user `f9d321b05e2e4c25825c95948e834e1e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:14.259953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:14.365639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1303/2618] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:14 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:14.856051 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:14.857423 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:14.946114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9c473-601e-476f-93ce-ddb88057cd56 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:14.951377 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:14.951989 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:14.952272 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:14.952573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:14.954420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:14.966459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:14.968086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:14.978682 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1316/2619] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:15.955778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:15.957895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:16.027623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b726abcb-1bf8-4326-aaa4-6c898313c641 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:16.035276 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:16.035912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:16.036192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:16.036467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] PATH_INFO: `/v3/users/3f5072251067403e8cc23d6b8116024a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:16.037586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f5072251067403e8cc23d6b8116024a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:16.039616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:16.052657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:16.089234 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f5072251067403e8cc23d6b8116024a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.102995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f5072251067403e8cc23d6b8116024a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.112172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f5072251067403e8cc23d6b8116024a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.112794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f5072251067403e8cc23d6b8116024a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.120511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f5072251067403e8cc23d6b8116024a'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.133507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1304/2620] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:15 2022] DELETE /identity/v3/users/3f5072251067403e8cc23d6b8116024a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:16.307325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:16.320663 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e0e659-60f9-474d-9a41-ffca278f8651 service placement] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:16.379785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:16.380410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:16.380691 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:16.380964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] PATH_INFO: `/v3/projects/ffcb73a8af784de9a0245dada92565fd` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:16.382109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffcb73a8af784de9a0245dada92565fd)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:16.384036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:16.430338 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffcb73a8af784de9a0245dada92565fd', 'request_id': 'req-d3181113-8e6c-41cf-8d91-e29d762aec4d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.436000 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffcb73a8af784de9a0245dada92565fd', 'request_id': 'req-d3181113-8e6c-41cf-8d91-e29d762aec4d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.443122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffcb73a8af784de9a0245dada92565fd', 'request_id': 'req-d3181113-8e6c-41cf-8d91-e29d762aec4d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.454924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] The token cache is being invalidate because project ffcb73a8af784de9a0245dada92565fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:16.455219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.455881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.457363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1317/2621] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:16 2022] DELETE /identity/v3/projects/ffcb73a8af784de9a0245dada92565fd => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:16.461374 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:16.462831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:16.476304 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbceedac-6f5c-4408-94f2-41493c1b4ac6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:16.531393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:16.531959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:16.532774 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:16.533056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] PATH_INFO: `/v3/users/f9d321b05e2e4c25825c95948e834e1e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:16.534207 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9d321b05e2e4c25825c95948e834e1e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:16.536166 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:16.582572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9d321b05e2e4c25825c95948e834e1e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.594506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9d321b05e2e4c25825c95948e834e1e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.602268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9d321b05e2e4c25825c95948e834e1e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.602893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9d321b05e2e4c25825c95948e834e1e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.609811 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-f53c14ed-0dff-434a-b1e4-c3ca515ae7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9d321b05e2e4c25825c95948e834e1e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.615808 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1305/2622] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:16 2022] DELETE /identity/v3/users/f9d321b05e2e4c25825c95948e834e1e => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:16.797168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:16.799552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:16.812516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3181113-8e6c-41cf-8d91-e29d762aec4d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:16.830644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:16.872018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:16.872646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:16.872928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:16.873200 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] PATH_INFO: `/v3/projects/b1c3997853ca42d49594cc3067a7804b` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:16.874309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1c3997853ca42d49594cc3067a7804b)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:16.876930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:16.922132 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1c3997853ca42d49594cc3067a7804b', 'request_id': 'req-22fd3036-fc4e-4cdd-a8b8-480d74b16482'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.928059 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1c3997853ca42d49594cc3067a7804b', 'request_id': 'req-22fd3036-fc4e-4cdd-a8b8-480d74b16482'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.935199 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1c3997853ca42d49594cc3067a7804b', 'request_id': 'req-22fd3036-fc4e-4cdd-a8b8-480d74b16482'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.948037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] The token cache is being invalidate because project b1c3997853ca42d49594cc3067a7804b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:16.948366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.949214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-22fd3036-fc4e-4cdd-a8b8-480d74b16482 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:16.950794 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1318/2623] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:16 2022] DELETE /identity/v3/projects/b1c3997853ca42d49594cc3067a7804b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:16.956742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:16.957232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:16.957232 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:16.977799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:16.979061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:16.983421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:17.047089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1306/2624] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:17.054753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.055054 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.055343 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.075422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:17.076644 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:17.085459 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1319/2625] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:17.089807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.105106 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354ed14-00b8-40a8-a29e-aff3774dac00 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.110066 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.111165 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.111718 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.112114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.112925 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:33:17.113332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.116984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.129349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1307/2626] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:33:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 17 23:33:17.133922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.144350 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb25a3-0211-418b-91cd-f305488bcf85 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.152467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.153110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.153924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.154221 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.154893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.158169 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.193607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1320/2627] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/projects => generated 379 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:17.197968 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.209410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d09a1d-b25b-470e-ba14-17c0405d1818 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.280367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.280971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.281252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.281526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.282679 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.284620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.312707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1308/2628] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/users => generated 290 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:33:17.314641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.324928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3965d529-9a67-486e-98ed-eb230802ee32 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.330378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.331046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.331328 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.331703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.332353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.333944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.344005 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1321/2629] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:17.348387 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.359033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baf4374-6b63-47c1-87a0-11e98eb8ee2c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.363965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e660b270-3dee-465e-8784-5487c9a1a135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.364575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b270-3dee-465e-8784-5487c9a1a135 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.364859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b270-3dee-465e-8784-5487c9a1a135 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.365130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e660b270-3dee-465e-8784-5487c9a1a135 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.365795 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b270-3dee-465e-8784-5487c9a1a135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.367452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e660b270-3dee-465e-8784-5487c9a1a135 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.379594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1309/2630] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:17.383462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.394444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e668d0-e213-4d9f-aadf-9eabd5d26720 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.399108 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.399761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.400042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.400318 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] PATH_INFO: `/v3/projects/5d83bc1f45ce4cd9b101856100b8d0b9/users/0ff676555b8c4f03b1d7a2717bf194d3/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.416055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d83bc1f45ce4cd9b101856100b8d0b9, user_id=0ff676555b8c4f03b1d7a2717bf194d3, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.418819 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.431734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1322/2631] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:17 2022] PUT /identity/v3/projects/5d83bc1f45ce4cd9b101856100b8d0b9/users/0ff676555b8c4f03b1d7a2717bf194d3/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:33:17.443768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.444268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.444712 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.476214 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] MFA Rules not processed for user `0ff676555b8c4f03b1d7a2717bf194d3`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:17.477552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:17.543866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1310/2632] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:17.548347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.597727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:17.614870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500301f9-fc24-4af2-ba5f-982027a78bb2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.619707 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.620344 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.620631 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.621244 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.621549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.623525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.658999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1323/2633] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/projects => generated 377 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:17.660301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.667266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:17.671951 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79bc869-035c-4484-ac31-91ad9af1d2e4 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.733996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.734614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.734926 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.735736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.736796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.738730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.764549 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1311/2634] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/users => generated 295 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:17.766068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.776595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50cdee-dc25-44e8-a396-4dbe5a973d66 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.782437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.783233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.783524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.783802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.784460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.786167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.796988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1324/2635] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:17.801941 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.812099 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a85e2-e18d-4ba9-ac29-29728959e414 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.817448 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.818102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.818385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.818662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] PATH_INFO: `/v3/projects/6e58eb34819d471db13166d088c6e655/users/681989f419544b9da6fafb04400a032d/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.833654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e58eb34819d471db13166d088c6e655, user_id=681989f419544b9da6fafb04400a032d, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.836338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.851000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1312/2636] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:17 2022] PUT /identity/v3/projects/6e58eb34819d471db13166d088c6e655/users/681989f419544b9da6fafb04400a032d/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:17.854879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.864873 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912cd4b7-c781-403d-8ce0-22ec55ad0187 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.923194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bdeab4-6f06-4655-a68a-17983e793bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.923846 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdeab4-6f06-4655-a68a-17983e793bde admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.924154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdeab4-6f06-4655-a68a-17983e793bde admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.924415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bdeab4-6f06-4655-a68a-17983e793bde admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.925056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdeab4-6f06-4655-a68a-17983e793bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.926653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bdeab4-6f06-4655-a68a-17983e793bde admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.936879 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1325/2637] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:33:17.941090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:17.952127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302e9df9-90c8-4df1-8553-4d80ffce3d83 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:17.957250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:17.957899 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.958180 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.958453 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] PATH_INFO: `/v3/projects/6e58eb34819d471db13166d088c6e655/users/681989f419544b9da6fafb04400a032d/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:17.960416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e58eb34819d471db13166d088c6e655, user_id=681989f419544b9da6fafb04400a032d, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:17.963210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:17.973994 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1313/2638] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:17 2022] PUT /identity/v3/projects/6e58eb34819d471db13166d088c6e655/users/681989f419544b9da6fafb04400a032d/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:17.984022 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1202-8b67-442a-ac85-71568309e478 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:17.984385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1202-8b67-442a-ac85-71568309e478 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:17.984727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f1202-8b67-442a-ac85-71568309e478 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:18.012826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-814f1202-8b67-442a-ac85-71568309e478 None None] MFA Rules not processed for user `681989f419544b9da6fafb04400a032d`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:18.014296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-814f1202-8b67-442a-ac85-71568309e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:18.085449 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1326/2639] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:17 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:18.097224 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:18.099197 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:18.157815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fcce15-87d3-4634-be98-5bf170af0dcb admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:18.161655 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:18.162254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:18.162534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:18.162842 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:18.216854 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:18.218269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:18.227678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1314/2640] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:18 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:19.594305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1202-8b67-442a-ac85-71568309e478 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:19.595779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-814f1202-8b67-442a-ac85-71568309e478 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:19.608480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f1202-8b67-442a-ac85-71568309e478 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:19.612977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:19.613714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:19.613998 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:19.614274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:19.623987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:19.625446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:19.636868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1327/2641] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:19.823421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:19.825005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:19.840409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:19.907437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3f74f3-13e4-4987-9610-b8a68b225b4b service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:19.913131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:19.913742 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:19.914025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:19.914311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:19.916049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:19.928563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:19.930175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6998e-c0a5-4de5-afcb-767da705fe3c service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:19.941243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1315/2642] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:23.427802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:23.466003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:23.500523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35aff5-5976-49fe-bbae-3f36493e525a service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:23.505508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:23.506141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:23.506422 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:23.506696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] PATH_INFO: `/v3/users/0ff676555b8c4f03b1d7a2717bf194d3` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:23.507868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff676555b8c4f03b1d7a2717bf194d3)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:23.509987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:23.565138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff676555b8c4f03b1d7a2717bf194d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:23.566185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff676555b8c4f03b1d7a2717bf194d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:23.582027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff676555b8c4f03b1d7a2717bf194d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:23.589987 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff676555b8c4f03b1d7a2717bf194d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:23.598907 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff676555b8c4f03b1d7a2717bf194d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:23.608604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1328/2643] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:23 2022] DELETE /identity/v3/users/0ff676555b8c4f03b1d7a2717bf194d3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:23.609989 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:23.610471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:23.610583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:23.631486 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:23.632699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:23.701432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1316/2644] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:23.708458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:23.710080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:23.778217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb218b6-8398-49ca-a895-f15bb7217ac9 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:23.782366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:23.783019 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:23.783877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:23.784181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:23.794278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:23.795975 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:23.809519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1329/2645] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:24.111147 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:24.112918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:24.127528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da68c92e-8158-4128-9cd4-02a989e237d1 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:24.132196 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:24.132993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:24.133278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:24.133558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] PATH_INFO: `/v3/projects/5d83bc1f45ce4cd9b101856100b8d0b9` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:24.135427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d83bc1f45ce4cd9b101856100b8d0b9)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:24.137548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:24.197786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d83bc1f45ce4cd9b101856100b8d0b9', 'request_id': 'req-ebd513c3-8862-48a2-b63b-97b08831dabe'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.203576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d83bc1f45ce4cd9b101856100b8d0b9', 'request_id': 'req-ebd513c3-8862-48a2-b63b-97b08831dabe'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.212251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d83bc1f45ce4cd9b101856100b8d0b9', 'request_id': 'req-ebd513c3-8862-48a2-b63b-97b08831dabe'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.223645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] The token cache is being invalidate because project 5d83bc1f45ce4cd9b101856100b8d0b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:24.223940 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.224601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.226418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1317/2646] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:24 2022] DELETE /identity/v3/projects/5d83bc1f45ce4cd9b101856100b8d0b9 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:24.230333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:24.241180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e979d-dcd9-4ce5-8a50-8ae0879dcafb service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:24.294144 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:24.306274 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:24.307094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:24.307474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:24.307848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] PATH_INFO: `/v3/users/681989f419544b9da6fafb04400a032d` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:24.309084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=681989f419544b9da6fafb04400a032d)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:24.311180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:24.359382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '681989f419544b9da6fafb04400a032d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.360063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '681989f419544b9da6fafb04400a032d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.373337 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '681989f419544b9da6fafb04400a032d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.381187 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '681989f419544b9da6fafb04400a032d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.388628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-b1f214b4-eadc-47c2-923b-4fcced5bcb58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '681989f419544b9da6fafb04400a032d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.399001 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1330/2647] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:24 2022] DELETE /identity/v3/users/681989f419544b9da6fafb04400a032d => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:24.674272 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:24.675820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:24.688694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd513c3-8862-48a2-b63b-97b08831dabe admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:24.709839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:24.754418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:24.755018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:24.755283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:24.755699 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] PATH_INFO: `/v3/projects/6e58eb34819d471db13166d088c6e655` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:24.756664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e58eb34819d471db13166d088c6e655)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:24.758581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:24.804736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e58eb34819d471db13166d088c6e655', 'request_id': 'req-45767860-54d4-42c5-9b5d-92204f5ce674'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.810280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e58eb34819d471db13166d088c6e655', 'request_id': 'req-45767860-54d4-42c5-9b5d-92204f5ce674'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.818372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e58eb34819d471db13166d088c6e655', 'request_id': 'req-45767860-54d4-42c5-9b5d-92204f5ce674'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.829349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] The token cache is being invalidate because project 6e58eb34819d471db13166d088c6e655 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:24.829641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.830287 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-45767860-54d4-42c5-9b5d-92204f5ce674 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:24.831819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1318/2648] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:24 2022] DELETE /identity/v3/projects/6e58eb34819d471db13166d088c6e655 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:24.836787 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:24.837259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:24.837376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:24.856765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:24.857967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:24.916951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1331/2649] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:24.925117 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:24.925406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:24.925686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:24.945370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:24.946579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:24.954531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1319/2650] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:24.959336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:24.968912 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518371f3-2cfa-4315-aba6-4eb625a6281d None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:24.974219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:24.974850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:24.975138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:24.975416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:24.976067 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:33:24.976374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:24.977976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:24.989525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1332/2651] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:33:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:33:24.993872 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.003909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6176f383-791b-4d3d-b7e7-d044df985a3e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.008612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.009150 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.009434 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.009707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.010468 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.012513 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.042295 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1320/2652] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:24 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:33:25.046513 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.056558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23b2e4d-10bf-44d2-8ce6-cba9c374e16c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.107233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:25.114359 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.115020 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.115480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.115920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.116767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.118711 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.138931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1333/2653] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:25 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:25.143730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.156306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ded74-a88d-4344-8ad4-4389aa9bc0d7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.161688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.162296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.162579 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.162909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.163562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.165187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.176703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1321/2654] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:25.180004 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.190979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e329178a-b2d2-439c-82bd-797686a2faee admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.195726 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ca3bb9-f20c-424d-a8f5-749d6065f73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.196324 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3bb9-f20c-424d-a8f5-749d6065f73e admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.196603 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3bb9-f20c-424d-a8f5-749d6065f73e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.196981 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ca3bb9-f20c-424d-a8f5-749d6065f73e admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.197682 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca3bb9-f20c-424d-a8f5-749d6065f73e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.199317 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ca3bb9-f20c-424d-a8f5-749d6065f73e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.209868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1334/2655] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:25.214820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.224929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660591d-bb7a-42ec-822c-40e889697300 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.229469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.230112 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.230393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.230662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] PATH_INFO: `/v3/projects/b589ce121496449dbe2e31ba2014bbac/users/88aa19c28abf4a2487fc2d40226153cb/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.245244 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b589ce121496449dbe2e31ba2014bbac, user_id=88aa19c28abf4a2487fc2d40226153cb, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.247906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.261203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1322/2656] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:25 2022] PUT /identity/v3/projects/b589ce121496449dbe2e31ba2014bbac/users/88aa19c28abf4a2487fc2d40226153cb/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:25.273495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.273869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.274210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.305166 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] MFA Rules not processed for user `88aa19c28abf4a2487fc2d40226153cb`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:25.306360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:25.368418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1335/2657] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:25.372981 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.420043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:25.435974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28dcd36-9788-4eb6-82b3-772d1b0c5c27 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.440843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.441444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.441724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.441997 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.442619 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.444540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.472770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1323/2658] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:25 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:25.476880 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.488369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbccd7ae-5d85-477f-bafa-bcf3dfcbc1fe None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.543853 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.544479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.544762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.545036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.545651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.547667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.568201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1336/2659] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:25 2022] POST /identity/v3/users => generated 298 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:25.572245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.583097 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771cc664-0991-45e3-a6c2-29f4c828c2ca admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.587683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.588283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.588566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.588844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.589518 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.591153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.602279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1324/2660] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:25.606195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.616064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b070a2a-7bc6-405a-ac63-5095f9df2cfb admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.620641 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.621282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.621565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.621839 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] PATH_INFO: `/v3/projects/bb73e125c99a4b2eb63ae43e42ee67e9/users/181fa4c5d6af495ebe1d1d8ab2ea1f72/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.636121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb73e125c99a4b2eb63ae43e42ee67e9, user_id=181fa4c5d6af495ebe1d1d8ab2ea1f72, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.638803 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.652495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1337/2661] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:25 2022] PUT /identity/v3/projects/bb73e125c99a4b2eb63ae43e42ee67e9/users/181fa4c5d6af495ebe1d1d8ab2ea1f72/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:25.656524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.667460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5405ac7-8b16-44d3-8555-7d0178ce7645 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.725491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57325362-9846-4402-aabf-c2acfaf774c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.726116 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325362-9846-4402-aabf-c2acfaf774c8 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.726372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325362-9846-4402-aabf-c2acfaf774c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.726651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57325362-9846-4402-aabf-c2acfaf774c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.727327 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325362-9846-4402-aabf-c2acfaf774c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.728932 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57325362-9846-4402-aabf-c2acfaf774c8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.738827 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1325/2662] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:25 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:25.743084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.753684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92043c-824c-48ed-a75c-9d898fcdf3ff admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.758295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.758974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.759253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.759526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] PATH_INFO: `/v3/projects/bb73e125c99a4b2eb63ae43e42ee67e9/users/181fa4c5d6af495ebe1d1d8ab2ea1f72/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.761570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb73e125c99a4b2eb63ae43e42ee67e9, user_id=181fa4c5d6af495ebe1d1d8ab2ea1f72, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:25.764257 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:25.775043 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1338/2663] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:25 2022] PUT /identity/v3/projects/bb73e125c99a4b2eb63ae43e42ee67e9/users/181fa4c5d6af495ebe1d1d8ab2ea1f72/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:25.785909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.786195 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.786474 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:25.815523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] MFA Rules not processed for user `181fa4c5d6af495ebe1d1d8ab2ea1f72`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:25.816707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:25.881749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1326/2664] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:25 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:25.892192 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:25.893993 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:25.915311 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:25.952762 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5551ae6b-bce3-42bf-aca4-3bd7ccdc5da0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:25.959178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:25.959789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:25.960071 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:25.960346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:26.016725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:26.018468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:26.027624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1339/2665] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:30.233206 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:30.234600 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:30.247189 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632b16ab-fc23-44ea-a093-79839f1b6a09 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:30.250669 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bbb1b4-4eb2-4c8b-9e02-9a7b8f73b5f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:30.251283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbb1b4-4eb2-4c8b-9e02-9a7b8f73b5f9 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:30.251561 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbb1b4-4eb2-4c8b-9e02-9a7b8f73b5f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:30.252707 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bbb1b4-4eb2-4c8b-9e02-9a7b8f73b5f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:30.261347 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbb1b4-4eb2-4c8b-9e02-9a7b8f73b5f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:30.262814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bbb1b4-4eb2-4c8b-9e02-9a7b8f73b5f9 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:30.272264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1327/2666] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:30 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:35.152268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:35.216228 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d735089e-eeb6-4728-9e37-37416c2a5a9f service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:35.220824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:35.221610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:35.221895 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:35.222248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] PATH_INFO: `/v3/users/88aa19c28abf4a2487fc2d40226153cb` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:35.223824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=88aa19c28abf4a2487fc2d40226153cb)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:35.227138 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:35.273569 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88aa19c28abf4a2487fc2d40226153cb'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.274278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88aa19c28abf4a2487fc2d40226153cb'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.286766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88aa19c28abf4a2487fc2d40226153cb'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.294198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88aa19c28abf4a2487fc2d40226153cb'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.296383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:35.303046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88aa19c28abf4a2487fc2d40226153cb'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.310041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1340/2667] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:35 2022] DELETE /identity/v3/users/88aa19c28abf4a2487fc2d40226153cb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:35.314381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:35.315444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:35.315776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:35.334476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:35.335724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:35.359077 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:35.395519 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1328/2668] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:35.405497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:35.406939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:35.463551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de357656-c21f-4d81-b04e-c01b729bd6bd admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:35.467243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:35.467853 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:35.468139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:35.468418 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:35.477522 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:35.478979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:35.488731 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1341/2669] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:35.756516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:35.758071 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:35.772382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f2ecd7-9897-4bb1-a4e6-a7792c38ce77 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:35.777623 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:35.778402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:35.778692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:35.779000 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] PATH_INFO: `/v3/projects/b589ce121496449dbe2e31ba2014bbac` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:35.780220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b589ce121496449dbe2e31ba2014bbac)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:35.782047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:35.828155 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b589ce121496449dbe2e31ba2014bbac', 'request_id': 'req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.833652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b589ce121496449dbe2e31ba2014bbac', 'request_id': 'req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.841807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b589ce121496449dbe2e31ba2014bbac', 'request_id': 'req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.853455 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] The token cache is being invalidate because project b589ce121496449dbe2e31ba2014bbac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:35.853747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.854399 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.855893 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1329/2670] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:35 2022] DELETE /identity/v3/projects/b589ce121496449dbe2e31ba2014bbac => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:35.860037 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:35.870755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2499e-9f86-4a26-8466-21929a3f12d7 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:35.927055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:35.927679 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:35.927959 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:35.928234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] PATH_INFO: `/v3/users/181fa4c5d6af495ebe1d1d8ab2ea1f72` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:35.929420 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=181fa4c5d6af495ebe1d1d8ab2ea1f72)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:35.931313 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:35.975928 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '181fa4c5d6af495ebe1d1d8ab2ea1f72'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.976580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '181fa4c5d6af495ebe1d1d8ab2ea1f72'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.988514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '181fa4c5d6af495ebe1d1d8ab2ea1f72'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:35.995727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '181fa4c5d6af495ebe1d1d8ab2ea1f72'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.003339 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3a3845a-0688-44d6-8f82-44e80de919ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '181fa4c5d6af495ebe1d1d8ab2ea1f72'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.009754 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1342/2671] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:35 2022] DELETE /identity/v3/users/181fa4c5d6af495ebe1d1d8ab2ea1f72 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:33:36.280599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.282101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:36.296355 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d336ca6b-2baf-4c00-a5eb-081e39ebb0d3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.360696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.361391 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.361665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.362169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] PATH_INFO: `/v3/projects/bb73e125c99a4b2eb63ae43e42ee67e9` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.363318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb73e125c99a4b2eb63ae43e42ee67e9)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.365233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.412662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb73e125c99a4b2eb63ae43e42ee67e9', 'request_id': 'req-bbdcccb2-795b-4483-97b8-2f8f3369edd1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.416533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:36.418906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb73e125c99a4b2eb63ae43e42ee67e9', 'request_id': 'req-bbdcccb2-795b-4483-97b8-2f8f3369edd1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.427185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb73e125c99a4b2eb63ae43e42ee67e9', 'request_id': 'req-bbdcccb2-795b-4483-97b8-2f8f3369edd1'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.438566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] The token cache is being invalidate because project bb73e125c99a4b2eb63ae43e42ee67e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:36.438889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.439522 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-bbdcccb2-795b-4483-97b8-2f8f3369edd1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:36.441528 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1330/2672] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:36 2022] DELETE /identity/v3/projects/bb73e125c99a4b2eb63ae43e42ee67e9 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:36.447464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.447951 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.448048 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.469877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:36.472137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:36.481958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:36.535062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1343/2673] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:36.544587 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.544876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.545178 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.564614 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:36.566574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:36.574464 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1331/2674] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:36.578594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.589142 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0cd8b7-51e6-48a0-9592-4b133ff00b5a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.593683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.594285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.594571 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.594881 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.595531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:33:36.595866 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.597659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.608892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1344/2675] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:33:36.613221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.622318 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dbc4da-9030-4094-a2ce-bc1b10ed083f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.627010 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.628151 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.628432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.628708 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.629342 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.631262 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.660978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1332/2676] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:36 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:36.665009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.678995 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448d246-b86c-4628-aa91-56ecff562df7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.733894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.734415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.734695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.734994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.735606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.737547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.758557 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1345/2677] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:36 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:33:36.762868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.774215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f000ed6-4967-4761-8785-61af9e6bc0d7 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.779264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.779864 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.780168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.780447 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.781088 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.782734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.792809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1333/2678] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:36.796825 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.807471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9057af0-f345-40ad-9847-b6a18578c7d5 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.812018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f27ca3e-7e25-47a0-89c6-503ae8680ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.812606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ca3e-7e25-47a0-89c6-503ae8680ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.812886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ca3e-7e25-47a0-89c6-503ae8680ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.813159 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f27ca3e-7e25-47a0-89c6-503ae8680ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.813796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27ca3e-7e25-47a0-89c6-503ae8680ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.816445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f27ca3e-7e25-47a0-89c6-503ae8680ef3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.826622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1346/2679] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:36.830618 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.840531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0f702-5f52-4e05-82fd-7d1c39a149a2 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:36.845092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:36.845728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.846050 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.846557 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] PATH_INFO: `/v3/projects/5dc29273ce8c4133aec6ba153fbb520a/users/ece5c900ee204c3d8aa6df36cec4fd47/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.860998 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5dc29273ce8c4133aec6ba153fbb520a, user_id=ece5c900ee204c3d8aa6df36cec4fd47, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:36.864297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:36.877958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1334/2680] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:36 2022] PUT /identity/v3/projects/5dc29273ce8c4133aec6ba153fbb520a/users/ece5c900ee204c3d8aa6df36cec4fd47/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:36.888650 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:36.888939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:36.889216 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:36.916361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] MFA Rules not processed for user `ece5c900ee204c3d8aa6df36cec4fd47`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:36.917595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:36.982055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1347/2681] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:36.994348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:36.996068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:37.057460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea950762-fb7a-4009-838e-265a66096749 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:37.061127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b57165-45bb-43a9-a504-10192626833d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:37.061740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b57165-45bb-43a9-a504-10192626833d service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:37.062025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b57165-45bb-43a9-a504-10192626833d service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:37.062301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b57165-45bb-43a9-a504-10192626833d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:37.071656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b57165-45bb-43a9-a504-10192626833d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:37.073120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b57165-45bb-43a9-a504-10192626833d service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:37.081851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1335/2682] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:36 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:39.685202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:39.695286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:39.748599 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d525963-bd95-4692-abd7-e93d6e5952b6 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:39.753064 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:39.754302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:39.754585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:39.754893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] PATH_INFO: `/v3/users/ece5c900ee204c3d8aa6df36cec4fd47` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:39.756010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ece5c900ee204c3d8aa6df36cec4fd47)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:39.757935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:39.803107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ece5c900ee204c3d8aa6df36cec4fd47'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:39.803781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ece5c900ee204c3d8aa6df36cec4fd47'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:39.815376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ece5c900ee204c3d8aa6df36cec4fd47'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:39.823708 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ece5c900ee204c3d8aa6df36cec4fd47'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:39.830456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ece5c900ee204c3d8aa6df36cec4fd47'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:39.837170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1348/2683] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:33:39 2022] DELETE /identity/v3/users/ece5c900ee204c3d8aa6df36cec4fd47 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:39.841667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:39.842145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:39.842241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:39.860884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:39.862078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:39.922815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1336/2684] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:39.933226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:39.934630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:40.006814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2a70a-776b-4ae9-93e0-e9eaf1cdfe45 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.010442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435de72f-5e88-4b14-84ef-42b8bb45cd55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.011074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de72f-5e88-4b14-84ef-42b8bb45cd55 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.011356 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de72f-5e88-4b14-84ef-42b8bb45cd55 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.011626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435de72f-5e88-4b14-84ef-42b8bb45cd55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.020704 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de72f-5e88-4b14-84ef-42b8bb45cd55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.022130 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435de72f-5e88-4b14-84ef-42b8bb45cd55 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.031630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1349/2685] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:40.299866 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.301918 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:40.315645 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae7dca9-c58b-487a-97a5-ba88af1e0f2a None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.320332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.320962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.321754 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.322035 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] PATH_INFO: `/v3/projects/5dc29273ce8c4133aec6ba153fbb520a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.323325 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5dc29273ce8c4133aec6ba153fbb520a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.325260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.341803 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:40.498494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5dc29273ce8c4133aec6ba153fbb520a', 'request_id': 'req-d370a3ff-c062-4983-900b-4ec536806c74'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:40.508120 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5dc29273ce8c4133aec6ba153fbb520a', 'request_id': 'req-d370a3ff-c062-4983-900b-4ec536806c74'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:40.514693 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5dc29273ce8c4133aec6ba153fbb520a', 'request_id': 'req-d370a3ff-c062-4983-900b-4ec536806c74'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:40.526784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] The token cache is being invalidate because project 5dc29273ce8c4133aec6ba153fbb520a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:33:40.527334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:40.527950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-d370a3ff-c062-4983-900b-4ec536806c74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:33:40.529421 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1337/2686] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:33:40 2022] DELETE /identity/v3/projects/5dc29273ce8c4133aec6ba153fbb520a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:40.534465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.535479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.535945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.555351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:40.556591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:40.582876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:40.617415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1350/2687] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:40.625423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.625912 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.626193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.646835 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:40.648021 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:40.656273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1338/2688] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:40.661271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.670936 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80470b91-1dfb-45bb-af80-705cccb87880 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.675503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.676193 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.676477 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.676753 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.677405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:33:40.677713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.679351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.690494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1351/2689] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:33:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:33:40.695123 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.704132 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42654303-1e50-4541-8073-e8ffbd4b6408 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.709721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.710299 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.710574 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.710885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.711497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.713598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.740631 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1339/2690] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:33:40 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:40.744716 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.755625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce726bc-8c9d-4a64-ab77-708bb396a0ec admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.812776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.813405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.813686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.813957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.814582 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.817148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.840604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1352/2691] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:33:40 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:33:40.841964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.852824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d13f8b6-c1e7-4bfa-bf46-8c311f61476a admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.857413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.858016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.858296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.858582 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.859246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.860859 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.871220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1340/2692] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:40.875063 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.885675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0dac9-5538-453a-8fa6-1ca0dd2263fd admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.890278 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37276ed7-db2c-4ae9-b031-a0ad4ada0e0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.890934 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276ed7-db2c-4ae9-b031-a0ad4ada0e0d admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.891220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276ed7-db2c-4ae9-b031-a0ad4ada0e0d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.891496 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37276ed7-db2c-4ae9-b031-a0ad4ada0e0d admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.892137 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37276ed7-db2c-4ae9-b031-a0ad4ada0e0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.893725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37276ed7-db2c-4ae9-b031-a0ad4ada0e0d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.903595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1353/2693] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:33:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:33:40.907562 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:40.917975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f221b6-99e7-4f9c-85f5-b4480128bbf6 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:40.922612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:40.923285 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.923571 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.923846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] PATH_INFO: `/v3/projects/51a514d56447415781eff36e9beaaec1/users/e03fa5cee2c04b678f62cb29d5bd8726/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.937799 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=51a514d56447415781eff36e9beaaec1, user_id=e03fa5cee2c04b678f62cb29d5bd8726, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:40.940442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:40.953323 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1341/2694] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:33:40 2022] PUT /identity/v3/projects/51a514d56447415781eff36e9beaaec1/users/e03fa5cee2c04b678f62cb29d5bd8726/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:33:40.958974 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5134a5-c108-4ee7-ad67-ed42beca4584 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:40.959261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5134a5-c108-4ee7-ad67-ed42beca4584 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:40.959535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5134a5-c108-4ee7-ad67-ed42beca4584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:40.977968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-0e5134a5-c108-4ee7-ad67-ed42beca4584 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:40.979209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0e5134a5-c108-4ee7-ad67-ed42beca4584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:41.038469 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1354/2695] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:33:41.048324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:41.050037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:41.106509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d5d131-0413-4a5d-9239-1dea119804ac admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:41.110139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:41.110771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:41.111057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:41.111335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:41.120684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:41.122096 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:41.131917 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1342/2696] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:41.778023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd938c1-c5a6-4e64-b12f-a3403067a913 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:41.778558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd938c1-c5a6-4e64-b12f-a3403067a913 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:41.778852 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd938c1-c5a6-4e64-b12f-a3403067a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:41.808213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8dd938c1-c5a6-4e64-b12f-a3403067a913 None None] MFA Rules not processed for user `e03fa5cee2c04b678f62cb29d5bd8726`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:41.809687 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8dd938c1-c5a6-4e64-b12f-a3403067a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:41.837752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:41.878074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1355/2697] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:33:41.889789 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:33:41.891343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:41.940356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:41.953233 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c593f7d0-a64b-4b1f-b6c6-6bac44efbbaa service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:33:41.957085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4aec4-4dd9-413a-9ab1-2f57bd99f2a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:33:41.957853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4aec4-4dd9-413a-9ab1-2f57bd99f2a3 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:41.958131 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4aec4-4dd9-413a-9ab1-2f57bd99f2a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:41.958401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4aec4-4dd9-413a-9ab1-2f57bd99f2a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:41.966975 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4aec4-4dd9-413a-9ab1-2f57bd99f2a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:33:41.968398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4aec4-4dd9-413a-9ab1-2f57bd99f2a3 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:33:41.979245 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1343/2698] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:33:41 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:33:43.332134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:33:43.332614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:33:43.332727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:33:43.351648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] MFA Rules not processed for user `e03fa5cee2c04b678f62cb29d5bd8726`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:33:43.353259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:33:43.359832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1356/2699] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:33:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:33:51.974938 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=6 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:33:53.346537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=18 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:34:09.482461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909cc8b-bd5d-44e4-a442-33698ce30d3b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:09.483359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909cc8b-bd5d-44e4-a442-33698ce30d3b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:09.483663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909cc8b-bd5d-44e4-a442-33698ce30d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:09.504794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e909cc8b-bd5d-44e4-a442-33698ce30d3b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:09.506251 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e909cc8b-bd5d-44e4-a442-33698ce30d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:09.515812 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1344/2700] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:09.550596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:09.552147 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:09.637588 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9fe7d-d5d8-455f-8f0e-516d1adf46bb None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:09.643530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13173a7a-f061-4a53-9797-3ebaec1213b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:09.644229 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13173a7a-f061-4a53-9797-3ebaec1213b7 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:09.644591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13173a7a-f061-4a53-9797-3ebaec1213b7 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:09.644941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13173a7a-f061-4a53-9797-3ebaec1213b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:09.654041 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13173a7a-f061-4a53-9797-3ebaec1213b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:09.655759 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13173a7a-f061-4a53-9797-3ebaec1213b7 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:09.666523 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1357/2701] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:10.584211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:10.584730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:10.584887 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:10.604552 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] MFA Rules not processed for user `135b1d2592964d0eb7327e4a64618774`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:10.605770 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:10.662568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1345/2702] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:34:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:12.556121 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1d01-f52b-4147-87d1-33dd3cb2ee5e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:12.556755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1d01-f52b-4147-87d1-33dd3cb2ee5e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:12.557336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe1d01-f52b-4147-87d1-33dd3cb2ee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:12.577674 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1dbe1d01-f52b-4147-87d1-33dd3cb2ee5e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:12.579111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1dbe1d01-f52b-4147-87d1-33dd3cb2ee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:12.588277 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1358/2703] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:12.602678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:12.615959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a45dac-4f9f-4ba7-a74f-bb3ce7954e0f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:12.622915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:12.623612 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:12.623888 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:12.624164 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:12.633173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:12.635037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:12.644714 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1346/2704] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:15.823052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678566-51b5-44a0-a5eb-587e7f98d34e None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:15.823566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678566-51b5-44a0-a5eb-587e7f98d34e None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:15.823672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73678566-51b5-44a0-a5eb-587e7f98d34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:15.843399 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-73678566-51b5-44a0-a5eb-587e7f98d34e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:15.844608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-73678566-51b5-44a0-a5eb-587e7f98d34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:15.854111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1359/2705] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:34:15.869084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:15.870473 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:15.885393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0889318-55d5-48bd-93d6-a0141c46e3c6 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:15.891819 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:15.892437 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:15.892855 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:15.893317 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:15.903266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:15.904914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:15.920051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1347/2706] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:34:18.906957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fefe-2d2d-4805-8c02-92f7509cbc6f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:18.907473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fefe-2d2d-4805-8c02-92f7509cbc6f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:18.907578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a251fefe-2d2d-4805-8c02-92f7509cbc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:18.927425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-a251fefe-2d2d-4805-8c02-92f7509cbc6f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:18.928640 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a251fefe-2d2d-4805-8c02-92f7509cbc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:18.937322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1360/2707] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:18.953186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:18.964598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9f95b-c46b-4027-b92c-96d1fb69f6c1 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:18.970328 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:18.970964 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:18.971247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:18.971524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:18.979851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:18.982175 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:18.991485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1348/2708] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:22.079688 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104b9b-2312-4c96-b058-474250e63041 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:22.080188 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104b9b-2312-4c96-b058-474250e63041 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:22.080281 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6104b9b-2312-4c96-b058-474250e63041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:22.100802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-e6104b9b-2312-4c96-b058-474250e63041 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:22.102525 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e6104b9b-2312-4c96-b058-474250e63041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:22.111285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1361/2709] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:22.127977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:22.142869 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711656d-8831-4e30-9f5b-dbd365e109ed service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:22.148584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:22.149288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:22.149641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:22.150102 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:22.160406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:22.162356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:22.174462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1349/2710] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:25.262427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78701d-1f09-46d6-8648-0fa3d5d0ebe5 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:25.262939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78701d-1f09-46d6-8648-0fa3d5d0ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:25.263042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78701d-1f09-46d6-8648-0fa3d5d0ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:25.283074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-0b78701d-1f09-46d6-8648-0fa3d5d0ebe5 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:25.284288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0b78701d-1f09-46d6-8648-0fa3d5d0ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:25.292348 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1362/2711] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:25.308729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:25.320575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9ba7d-1ae1-4e22-a5e4-0e3e5c8140e3 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:25.326651 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3205e9-0c52-4f7d-a534-296849c8538b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:25.327263 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3205e9-0c52-4f7d-a534-296849c8538b service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:25.327547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3205e9-0c52-4f7d-a534-296849c8538b service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:25.327823 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3205e9-0c52-4f7d-a534-296849c8538b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:25.336168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3205e9-0c52-4f7d-a534-296849c8538b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:25.337732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3205e9-0c52-4f7d-a534-296849c8538b service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:25.347056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1350/2712] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:35.277258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=49 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:34:35.342959 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=58 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:34:40.467793 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:40.468292 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:40.468398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:40.488441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] MFA Rules not processed for user `e03fa5cee2c04b678f62cb29d5bd8726`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:40.489648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:40.496855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1363/2713] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:34:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:50.483725 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:34:53.212127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f145-0e75-4a6c-9cab-05d2bf17ca0d None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:53.212702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f145-0e75-4a6c-9cab-05d2bf17ca0d None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:53.212702 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f145-0e75-4a6c-9cab-05d2bf17ca0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:53.292908 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-6b79f145-0e75-4a6c-9cab-05d2bf17ca0d None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:53.298649 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-6b79f145-0e75-4a6c-9cab-05d2bf17ca0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:53.349337 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1351/2714] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:53.367635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:53.429182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84f4487-773d-4927-bd82-d10c930b5ab7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:53.434797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:53.435487 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:53.435770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:53.436046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:53.444293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:53.445876 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:53.456006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1364/2715] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:56.482069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:56.482624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:56.482624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:56.501311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:56.502484 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:56.510054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1352/2716] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:56.525006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:56.537223 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f2b618-5b00-40d9-931b-865356d64766 service nova] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:56.542653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d6fa8-d389-475c-913d-471fad7ea1e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:56.543276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6fa8-d389-475c-913d-471fad7ea1e0 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:56.543563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6fa8-d389-475c-913d-471fad7ea1e0 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:56.543843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d6fa8-d389-475c-913d-471fad7ea1e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:56.551892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d6fa8-d389-475c-913d-471fad7ea1e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:56.553467 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d6fa8-d389-475c-913d-471fad7ea1e0 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:56.563182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1365/2717] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:58.753424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:58.754847 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:58.843457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95070e4c-008f-4d7e-a47c-dee7709ee879 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:58.848373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:58.848971 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:58.849253 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:58.849527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:58.851268 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:58.863126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:58.864721 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:58.875052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1353/2718] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:34:59.578606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b12b0-4924-4148-82d8-e8068a4a1e6b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:59.579118 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b12b0-4924-4148-82d8-e8068a4a1e6b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:59.579431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1b12b0-4924-4148-82d8-e8068a4a1e6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:59.599639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-fb1b12b0-4924-4148-82d8-e8068a4a1e6b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:34:59.601047 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fb1b12b0-4924-4148-82d8-e8068a4a1e6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:34:59.609767 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1366/2719] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:34:59.624813 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:34:59.637025 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030f44fd-6a77-4644-9b28-44b9247e22fa service placement] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:34:59.644768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:34:59.645370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:34:59.645678 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:34:59.645950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:34:59.656087 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:34:59.657672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:34:59.667764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1354/2720] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:02.731456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a916b-e50d-48d2-a381-535b2c3c4437 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:02.731957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a916b-e50d-48d2-a381-535b2c3c4437 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:02.732084 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a916b-e50d-48d2-a381-535b2c3c4437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:02.751988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-f87a916b-e50d-48d2-a381-535b2c3c4437 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:02.753182 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-f87a916b-e50d-48d2-a381-535b2c3c4437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:02.760990 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1367/2721] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:02.784848 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:02.796766 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a522e42d-3253-455f-8ed5-10bd572d2619 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:02.802229 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:02.802850 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:02.803137 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:02.803414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:02.811584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:02.813138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:02.817014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:02.823783 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1355/2722] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:05.896532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e62d-a0db-4208-9b6e-e3ecb26bc72a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:05.897042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e62d-a0db-4208-9b6e-e3ecb26bc72a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:05.897202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8744e62d-a0db-4208-9b6e-e3ecb26bc72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:05.917665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-8744e62d-a0db-4208-9b6e-e3ecb26bc72a None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:05.918900 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-8744e62d-a0db-4208-9b6e-e3ecb26bc72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:05.926850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1368/2723] 10.222.0.52 () {58 vars in 1016 bytes} [Wed Aug 17 23:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:05.945724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:05.957570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f4fdf3-bc06-4ed0-b7f6-675d2c11fb70 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:05.963367 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:05.964654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:05.964654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:05.964654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:05.972903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:05.974469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:05.983762 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1356/2724] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:12.361672 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:12.362163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:12.362282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:12.381614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] MFA Rules not processed for user `135b1d2592964d0eb7327e4a64618774`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:12.382848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:12.389659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1369/2725] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:15.979567 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=7 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:22.377062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=45 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:35.016709 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.018734 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:35.033616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c13cd-e1ad-42c4-a6e3-97693ecdb5b4 service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.039724 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.040332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.040613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.040885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.042588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:35.055476 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.057089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.067617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1357/2726] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:35.093266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.109363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272561be-3abc-4ddb-bd04-5c9d05cf07b8 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.114031 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.114659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.114967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.115241 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] PATH_INFO: `/v3/users/e03fa5cee2c04b678f62cb29d5bd8726` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.116370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e03fa5cee2c04b678f62cb29d5bd8726)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.118391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.164501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e03fa5cee2c04b678f62cb29d5bd8726'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.165154 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e03fa5cee2c04b678f62cb29d5bd8726'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.177036 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e03fa5cee2c04b678f62cb29d5bd8726'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.184298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e03fa5cee2c04b678f62cb29d5bd8726'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.191296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-420a80da-cfb7-4ef5-b6e7-0309f132fcb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e03fa5cee2c04b678f62cb29d5bd8726'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.197240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1370/2727] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:35:35 2022] DELETE /identity/v3/users/e03fa5cee2c04b678f62cb29d5bd8726 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:35.372497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.383283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c2b77a-70a1-44e7-962b-6d5986cbf576 service placement] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.445624 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.446235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.446517 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.446824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] PATH_INFO: `/v3/projects/51a514d56447415781eff36e9beaaec1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.447943 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] RBAC: Authorizing `identity:delete_project(project_id=51a514d56447415781eff36e9beaaec1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.449829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.495481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51a514d56447415781eff36e9beaaec1', 'request_id': 'req-8904f85b-dac0-4f9b-8800-d43a95e8796c'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.500876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51a514d56447415781eff36e9beaaec1', 'request_id': 'req-8904f85b-dac0-4f9b-8800-d43a95e8796c'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.508148 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51a514d56447415781eff36e9beaaec1', 'request_id': 'req-8904f85b-dac0-4f9b-8800-d43a95e8796c'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.519360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] The token cache is being invalidate because project 51a514d56447415781eff36e9beaaec1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:35:35.519647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.520292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8904f85b-dac0-4f9b-8800-d43a95e8796c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:35.521753 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1358/2728] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:35:35 2022] DELETE /identity/v3/projects/51a514d56447415781eff36e9beaaec1 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:35.526630 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.526960 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.527271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.547340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:35.548554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:35.608303 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1371/2729] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:35:35.617592 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.617874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.618146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.637173 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:35.638301 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:35.646670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1359/2730] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:35.650734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.661161 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12073fac-aa15-4b5d-b284-9c4c05c72343 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.666027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.666628 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.666944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.667217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.667868 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:35:35.668197 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.669792 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.681498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1372/2731] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:35:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:35:35.685672 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.695492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f2764-b3b8-4f39-8e80-792623ac46cb None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.699986 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.700565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.700844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.701114 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.701726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.703644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.732085 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1360/2732] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:35:35 2022] POST /identity/v3/projects => generated 399 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:35:35.736107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.745877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e9f7-7a0f-445f-b3de-fb6c523c0c22 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.801639 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.802235 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.802516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.802822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.803447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.805392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.814028 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:35.828992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1373/2733] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:35:35 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:35:35.830344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.841159 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba51fbd-c023-49cd-ae71-2fd60a302dd5 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.845671 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.847101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.847444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.847748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.848383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.849958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.859429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1361/2734] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:35:35.863284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.873129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b72bd0-2d41-46bf-98df-de08a8cf9ccc admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.878033 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac233e-f089-44df-880d-6c85f715148b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.878635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac233e-f089-44df-880d-6c85f715148b admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.878956 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac233e-f089-44df-880d-6c85f715148b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.879247 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac233e-f089-44df-880d-6c85f715148b admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.879894 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac233e-f089-44df-880d-6c85f715148b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.881490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac233e-f089-44df-880d-6c85f715148b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.891925 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1374/2735] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:35:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:35:35.896496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:35.906494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff875fc-c9b5-42b6-96eb-a60353a12548 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:35.912032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:35.912703 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.912983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.913259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] PATH_INFO: `/v3/projects/0f82faec7437419b961d6519f7e7ec30/users/9491ed932d8648e7872bed727fa0a329/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.930176 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f82faec7437419b961d6519f7e7ec30, user_id=9491ed932d8648e7872bed727fa0a329, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:35.933536 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:35.946634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1362/2736] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:35:35 2022] PUT /identity/v3/projects/0f82faec7437419b961d6519f7e7ec30/users/9491ed932d8648e7872bed727fa0a329/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:35.957440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:35.957732 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:35.958012 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:35.986233 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] MFA Rules not processed for user `9491ed932d8648e7872bed727fa0a329`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:35.987486 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:36.050984 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1375/2737] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:35 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:36.062273 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:36.063988 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:36.082863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:36.142531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a86c4fc-2f2d-4f2f-8218-cee0cc051f88 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:36.146720 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43b4444-6b92-4ea5-9e13-4eea092962e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:36.147332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4444-6b92-4ea5-9e13-4eea092962e2 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:36.147611 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4444-6b92-4ea5-9e13-4eea092962e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:36.147885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43b4444-6b92-4ea5-9e13-4eea092962e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:36.156187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b4444-6b92-4ea5-9e13-4eea092962e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:36.157653 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43b4444-6b92-4ea5-9e13-4eea092962e2 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:36.166457 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1363/2738] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:36 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:41.147284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:41.209362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011dfe0f-1d66-4b4e-86f2-59341c748a7b None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:41.213949 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:41.214761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:41.215049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:41.215325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] PATH_INFO: `/v3/users/9491ed932d8648e7872bed727fa0a329` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:41.216439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9491ed932d8648e7872bed727fa0a329)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:41.218369 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:41.270488 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9491ed932d8648e7872bed727fa0a329'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.271173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9491ed932d8648e7872bed727fa0a329'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.283620 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9491ed932d8648e7872bed727fa0a329'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.287822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:41.295021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9491ed932d8648e7872bed727fa0a329'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.304325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9491ed932d8648e7872bed727fa0a329'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.310196 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1376/2739] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:35:41 2022] DELETE /identity/v3/users/9491ed932d8648e7872bed727fa0a329 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:41.314765 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:41.315231 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:41.315329 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:41.333944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:41.335168 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:41.394533 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1364/2740] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:41.404493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:41.405885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:41.484253 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730218e2-ed89-4354-9cb8-74198e518e53 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:41.488561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a7cb4b-3e2d-42d2-9481-506c77ecc226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:41.489333 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7cb4b-3e2d-42d2-9481-506c77ecc226 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:41.489609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7cb4b-3e2d-42d2-9481-506c77ecc226 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:41.489882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a7cb4b-3e2d-42d2-9481-506c77ecc226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:41.498670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7cb4b-3e2d-42d2-9481-506c77ecc226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:41.500114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a7cb4b-3e2d-42d2-9481-506c77ecc226 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:41.509493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1377/2741] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:41.795780 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:41.797208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:41.809953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67f4c7-1c94-497a-bbe0-46804b756697 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:41.814540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:41.815208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:41.815488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:41.815760 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] PATH_INFO: `/v3/projects/0f82faec7437419b961d6519f7e7ec30` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:41.816913 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f82faec7437419b961d6519f7e7ec30)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:41.818880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:41.865580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f82faec7437419b961d6519f7e7ec30', 'request_id': 'req-6ee66794-1f7e-4131-a854-2503123fd3b7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.871033 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f82faec7437419b961d6519f7e7ec30', 'request_id': 'req-6ee66794-1f7e-4131-a854-2503123fd3b7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.878353 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f82faec7437419b961d6519f7e7ec30', 'request_id': 'req-6ee66794-1f7e-4131-a854-2503123fd3b7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.889488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] The token cache is being invalidate because project 0f82faec7437419b961d6519f7e7ec30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:35:41.889781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.890411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-6ee66794-1f7e-4131-a854-2503123fd3b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:35:41.891902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1365/2742] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:35:41 2022] DELETE /identity/v3/projects/0f82faec7437419b961d6519f7e7ec30 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:41.897696 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:41.898050 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:41.898331 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:41.919141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:41.923517 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:41.983251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1378/2743] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:41.991601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:41.991885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:41.992158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.011728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:42.012919 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:42.021313 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1366/2744] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:42.025475 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.035362 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252a262b-bcb9-45b9-af01-100aa67367ef None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.039891 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.040490 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.040776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.041057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.041714 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:35:42.042024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.043662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.055591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1379/2745] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:35:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:35:42.059844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.069798 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63715e27-c76c-4e25-a000-c15ea9f12923 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.074356 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.074966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.075250 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.075629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.076247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.078111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.089895 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:42.106140 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1367/2746] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:35:42 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:35:42.110291 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.120415 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573a4f8a-b20b-4f8a-b847-c49e1e37918d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.170740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:42.177357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.177935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.178226 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.178503 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.179163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.181139 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.207779 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1380/2747] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:35:42 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:35:42.211796 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.221965 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9d8855-c70e-454b-8740-9d31879d69d9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.226821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.227427 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.227737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.228016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.228689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.230283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.247375 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1368/2748] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:35:42.251405 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.262099 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76b8e6e-3e96-42be-9644-8cb5f2fbf1ec admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.266609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acde901-0107-4b1e-8e7e-36d136e5163a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.267234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acde901-0107-4b1e-8e7e-36d136e5163a admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.267520 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acde901-0107-4b1e-8e7e-36d136e5163a admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.267796 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acde901-0107-4b1e-8e7e-36d136e5163a admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.268465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acde901-0107-4b1e-8e7e-36d136e5163a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.270874 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acde901-0107-4b1e-8e7e-36d136e5163a admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.281646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1381/2749] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:35:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:35:42.286397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.296572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168f700-b2a2-4e05-9239-470dabe959f3 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.301880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.302527 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.302840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.303118 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] PATH_INFO: `/v3/projects/f63cbb6abd7a4200bb0a72f92d4ee6a8/users/064bcb7672ae4527a3b77980d3aac036/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.317680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f63cbb6abd7a4200bb0a72f92d4ee6a8, user_id=064bcb7672ae4527a3b77980d3aac036, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.320350 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.333698 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1369/2750] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:35:42 2022] PUT /identity/v3/projects/f63cbb6abd7a4200bb0a72f92d4ee6a8/users/064bcb7672ae4527a3b77980d3aac036/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:35:42.338770 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3c0b6-1826-4c19-86c0-eec9b9bf8b54 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.339065 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3c0b6-1826-4c19-86c0-eec9b9bf8b54 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.339340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3c0b6-1826-4c19-86c0-eec9b9bf8b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.358250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-ebc3c0b6-1826-4c19-86c0-eec9b9bf8b54 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:42.359471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-ebc3c0b6-1826-4c19-86c0-eec9b9bf8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:42.418349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1382/2751] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:42.428080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:42.429794 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:42.485822 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807f1fb7-bbad-48c3-8414-c3896d0b00d8 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:42.489613 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:42.490210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:42.490491 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:42.490791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:42.499480 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:42.500903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:42.510303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1370/2752] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:46.468634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.469181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.469181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.504411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] MFA Rules not processed for user `064bcb7672ae4527a3b77980d3aac036`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:46.505646 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:46.598744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1383/2753] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:46.602296 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:46.612376 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cb10f5-1b6e-46f3-80dc-ae045a1600fc service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:46.617540 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:46.618215 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.618580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.619108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.619817 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:46.621836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:46.653184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1371/2754] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:35:46 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:35:46.657850 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:46.669385 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fedc3f-7f94-4b36-80ff-8e1be62ae9a4 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:46.730501 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:46.731302 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.731584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.731863 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.732518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:46.734456 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:46.746400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:46.758334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1384/2755] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:35:46 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:35:46.762472 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:46.773607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bc37ed-ffc0-436a-93b7-c0bcd6a6481c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:46.778309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:46.779225 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.779509 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.779786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.780438 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:46.782069 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:46.793265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1372/2756] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:35:46.797595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:46.808440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2670a30b-e7ac-46d8-ae4c-21f13c0c7132 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:46.813565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:46.814273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.814555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.814864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] PATH_INFO: `/v3/projects/952d38a6393f48f29a65a65a90417515/users/47fef6ee14e04802bdbd1b6ec1485822/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.831374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=952d38a6393f48f29a65a65a90417515, user_id=47fef6ee14e04802bdbd1b6ec1485822, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:46.834647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:46.850251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1385/2757] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:35:46 2022] PUT /identity/v3/projects/952d38a6393f48f29a65a65a90417515/users/47fef6ee14e04802bdbd1b6ec1485822/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:46.854134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:46.865681 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f05d4-6852-48d7-89fd-deb33f6bdcec admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:46.924781 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160ab265-6926-4604-893e-03f9ce069849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:46.925953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ab265-6926-4604-893e-03f9ce069849 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.926261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ab265-6926-4604-893e-03f9ce069849 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.926820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160ab265-6926-4604-893e-03f9ce069849 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.927203 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ab265-6926-4604-893e-03f9ce069849 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:46.928804 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160ab265-6926-4604-893e-03f9ce069849 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:46.939584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1373/2758] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:35:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:35:46.944009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:46.954671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db98bc39-3a21-4770-85ce-f90b4f9e65d2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:46.959854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:46.960531 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:46.960818 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:46.961102 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] PATH_INFO: `/v3/projects/952d38a6393f48f29a65a65a90417515/users/47fef6ee14e04802bdbd1b6ec1485822/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:46.963151 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=952d38a6393f48f29a65a65a90417515, user_id=47fef6ee14e04802bdbd1b6ec1485822, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:46.965941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:46.976695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1386/2759] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:35:46 2022] PUT /identity/v3/projects/952d38a6393f48f29a65a65a90417515/users/47fef6ee14e04802bdbd1b6ec1485822/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:35:51.277570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e069-e9b5-48a2-ac12-9e9f59f6b289 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:51.278743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e069-e9b5-48a2-ac12-9e9f59f6b289 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:51.279184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833e069-e9b5-48a2-ac12-9e9f59f6b289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:51.309599 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9833e069-e9b5-48a2-ac12-9e9f59f6b289 None None] MFA Rules not processed for user `47fef6ee14e04802bdbd1b6ec1485822`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:51.310834 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9833e069-e9b5-48a2-ac12-9e9f59f6b289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:51.321373 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:35:51.383849 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1374/2760] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:35:51 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:51.396378 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:51.398113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:51.460516 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc58ec6-181c-4bfe-87aa-92d05e77bd0e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:51.464764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dfaa389252804cb980cf4fc92928000d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:51.465466 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:51.465826 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:51.466184 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:51.547801 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:51.549347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:51.559382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1387/2761] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:35:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:35:51.698079 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebde18-4898-4ab6-a55a-26c7c8b90294 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:51.698680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebde18-4898-4ab6-a55a-26c7c8b90294 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:51.698995 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ebde18-4898-4ab6-a55a-26c7c8b90294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:51.750470 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-00ebde18-4898-4ab6-a55a-26c7c8b90294 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:35:51.753194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-00ebde18-4898-4ab6-a55a-26c7c8b90294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:51.815481 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1375/2762] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:35:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:35:51.873848 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:35:51.875347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:35:51.952015 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148b8be1-bec5-4a4a-87da-51d848013b7d service glance] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:35:51.957896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cee958-7a89-4dff-b4d7-18d7d31cceb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:35:51.958524 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee958-7a89-4dff-b4d7-18d7d31cceb8 service swift] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:35:51.958838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee958-7a89-4dff-b4d7-18d7d31cceb8 service swift] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:35:51.959119 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cee958-7a89-4dff-b4d7-18d7d31cceb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:35:51.968402 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee958-7a89-4dff-b4d7-18d7d31cceb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:35:51.969941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cee958-7a89-4dff-b4d7-18d7d31cceb8 service swift] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:35:51.979364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1388/2763] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:35:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:36:00.519265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:00.519743 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:00.519961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:00.540258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] MFA Rules not processed for user `064bcb7672ae4527a3b77980d3aac036`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:00.541383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:00.548494 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1376/2764] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:01.975560 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=97,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:02.383341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:02.383633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:02.384764 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:02.405892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:02.407327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:02.416986 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1389/2765] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:36:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:02.430146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:02.442395 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5282ea1e-e23f-434c-9ab4-c7c0705b63ac None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:02.447516 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:02.448124 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:02.448408 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:02.448686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:02.457348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:02.458958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:02.467153 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1377/2766] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:36:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:36:12.400288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:12.464279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=62 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:25.174653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:25.233349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f75413-910d-4474-948a-9a23d2a5e16f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:25.237173 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:25.237790 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:25.238077 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:25.238357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:25.248124 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:25.249575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:25.261662 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1390/2767] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:25 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:26.128492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:26.130037 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:26.203648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887e6960-d095-4642-9d0e-13b588dfa43d service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:26.214193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:26.216048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:26.216270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:26.216547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] PATH_INFO: `/v3/users/135b1d2592964d0eb7327e4a64618774` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:26.217860 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] RBAC: Authorizing `identity:delete_user(user_id=135b1d2592964d0eb7327e4a64618774)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:26.220208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:26.277967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '135b1d2592964d0eb7327e4a64618774'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.300510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '135b1d2592964d0eb7327e4a64618774'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.312194 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '135b1d2592964d0eb7327e4a64618774'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.312768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '135b1d2592964d0eb7327e4a64618774'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.321247 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-59398d0a-df5c-4b27-a56c-583cf0c5a283 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '135b1d2592964d0eb7327e4a64618774'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.333345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1378/2768] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:26 2022] DELETE /identity/v3/users/135b1d2592964d0eb7327e4a64618774 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:26.534632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:26.547455 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70069fd3-9997-4905-a4b6-b9293a8409cd service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:26.616870 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:26.617733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:26.618018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:26.618296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] PATH_INFO: `/v3/projects/0e9f5b5cb89d48528096cee8088f673c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:26.619438 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e9f5b5cb89d48528096cee8088f673c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:26.621357 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:26.668903 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e9f5b5cb89d48528096cee8088f673c', 'request_id': 'req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.674510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e9f5b5cb89d48528096cee8088f673c', 'request_id': 'req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.683029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e9f5b5cb89d48528096cee8088f673c', 'request_id': 'req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.695298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] The token cache is being invalidate because project 0e9f5b5cb89d48528096cee8088f673c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:26.695598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.696251 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-3c2c8598-9c20-40a3-af6d-2a79c76cdf5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:26.698002 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1391/2769] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:26 2022] DELETE /identity/v3/projects/0e9f5b5cb89d48528096cee8088f673c => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:26.702577 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:26.703032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:26.703392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:26.723390 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:26.724607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:26.795062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1379/2770] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:26.802665 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:26.802992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:26.803271 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:26.825479 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:26.826595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:26.834813 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1392/2771] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:26.839022 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:26.848727 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3750a916-1238-4eac-af65-dabec4508fd8 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:26.854086 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:26.854737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:26.855047 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:26.855324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:26.855978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:36:26.856278 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:26.857889 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:26.870498 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1380/2772] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:36:26.874761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:26.884164 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f5f427-4808-4618-8faa-a8c0e87959a2 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:26.889176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:26.889808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:26.890089 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:26.890363 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:26.891049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:26.892971 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:26.921832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1393/2773] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:26 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:36:26.925851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:26.936255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17f0a6d-1eb1-49c0-91e2-b9dcbcf0554d admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:26.939956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:26.999439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.000056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.000335 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.000706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.001515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.003423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.035650 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1381/2774] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:26 2022] POST /identity/v3/users => generated 291 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:36:27.036591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.044177 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:27.051365 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5963ba6c-f555-4921-b3e5-48e7b984148d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.058035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.058661 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.058982 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.059563 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.059932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.061566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.079651 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1394/2775] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:27.081460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.094886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62b6d07-aebb-4488-b89c-b0a04ef96b9e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.107144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa47807-1da5-43f9-addf-3d1da1403f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.107768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47807-1da5-43f9-addf-3d1da1403f24 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.108049 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47807-1da5-43f9-addf-3d1da1403f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.108321 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa47807-1da5-43f9-addf-3d1da1403f24 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.108977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa47807-1da5-43f9-addf-3d1da1403f24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.115696 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa47807-1da5-43f9-addf-3d1da1403f24 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.133005 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1382/2776] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:27.137180 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.150117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978024d-5f59-4919-a4f7-37f8b8891356 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.156452 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.157408 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.157882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.158425 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] PATH_INFO: `/v3/projects/d635d2fd984247559dd011e2f4f855d0/users/814641bf0eb44aaa87332f99229f89ff/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.176381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d635d2fd984247559dd011e2f4f855d0, user_id=814641bf0eb44aaa87332f99229f89ff, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.179944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.196824 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1395/2777] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:27 2022] PUT /identity/v3/projects/d635d2fd984247559dd011e2f4f855d0/users/814641bf0eb44aaa87332f99229f89ff/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:27.207248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.207658 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.208003 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.239541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] MFA Rules not processed for user `814641bf0eb44aaa87332f99229f89ff`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:27.241080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:27.354844 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1383/2778] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:27.360843 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.470810 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b6185-1703-4a2f-999a-23bb032f432e admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.495255 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.496780 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.498321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.498660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.500893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.504148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.552561 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1396/2779] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:27 2022] POST /identity/v3/projects => generated 381 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:27.557445 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.570632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0540e888-f262-4739-b530-9ecdb9b78229 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.680409 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.681271 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.681558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.681831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.682488 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.684840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.718929 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1384/2780] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:27 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:27.723285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.737393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7522e-037d-41cc-9732-c1a01e056529 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.744776 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.745729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.746174 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.746451 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.747755 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.749797 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.767761 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1397/2781] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:27.772307 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.781764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:27.787091 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56bd5f9-d7fd-4167-a2fa-8b708f6b1a90 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.798744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.799972 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.800406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.800791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] PATH_INFO: `/v3/projects/7118ad229d0b467390a14fba4906fc57/users/98d3ceed6d4f473a88fe4d531eada9bb/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.822397 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7118ad229d0b467390a14fba4906fc57, user_id=98d3ceed6d4f473a88fe4d531eada9bb, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.825555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.841541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1385/2782] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:27 2022] PUT /identity/v3/projects/7118ad229d0b467390a14fba4906fc57/users/98d3ceed6d4f473a88fe4d531eada9bb/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:27.845300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.856493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bd6978-1604-4e16-8509-74341083025d admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.926334 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7ac90-7009-4e80-8db9-88651fbf3b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.926983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ac90-7009-4e80-8db9-88651fbf3b16 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.927266 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ac90-7009-4e80-8db9-88651fbf3b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.927539 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7ac90-7009-4e80-8db9-88651fbf3b16 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.928189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ac90-7009-4e80-8db9-88651fbf3b16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.931276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7ac90-7009-4e80-8db9-88651fbf3b16 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.945656 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1398/2783] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:36:27.947673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:27.960167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1661402-598c-40d3-a859-18bddec6f86e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:27.965915 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:27.966576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:27.966909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:27.967240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] PATH_INFO: `/v3/projects/7118ad229d0b467390a14fba4906fc57/users/98d3ceed6d4f473a88fe4d531eada9bb/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:27.969264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7118ad229d0b467390a14fba4906fc57, user_id=98d3ceed6d4f473a88fe4d531eada9bb, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:27.972026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:27.992497 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1386/2784] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:27 2022] PUT /identity/v3/projects/7118ad229d0b467390a14fba4906fc57/users/98d3ceed6d4f473a88fe4d531eada9bb/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:28.004236 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:28.004931 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:28.005386 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:28.041935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] MFA Rules not processed for user `98d3ceed6d4f473a88fe4d531eada9bb`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:28.043654 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:28.079434 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:28.127298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1399/2785] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:28 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:28.145211 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:28.146987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:28.215767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a139a2-f5e6-4377-bf41-faf11373f439 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:28.220061 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:28.220692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:28.220977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:28.221254 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:28.233101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:28.234676 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:28.245903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1387/2786] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:28 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:28.341877 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:28.353090 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c0931b-ceb4-4730-9b48-b0ab767f887a None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:28.356840 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73d525e-fdf0-4a7e-9fcd-aa45b00c6353 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:28.357462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d525e-fdf0-4a7e-9fcd-aa45b00c6353 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:28.357799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d525e-fdf0-4a7e-9fcd-aa45b00c6353 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:28.358016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73d525e-fdf0-4a7e-9fcd-aa45b00c6353 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:28.428842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d525e-fdf0-4a7e-9fcd-aa45b00c6353 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:28.430398 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73d525e-fdf0-4a7e-9fcd-aa45b00c6353 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:28.441011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1400/2787] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:28 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:35.215377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:35.275432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa7187a-8503-48a3-9855-2949a9dffacc service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:35.280184 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:35.280805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:35.281080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:35.281349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] PATH_INFO: `/v3/users/814641bf0eb44aaa87332f99229f89ff` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:35.282565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=814641bf0eb44aaa87332f99229f89ff)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:35.284572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:35.329898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '814641bf0eb44aaa87332f99229f89ff'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.342506 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '814641bf0eb44aaa87332f99229f89ff'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.350444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '814641bf0eb44aaa87332f99229f89ff'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.351144 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '814641bf0eb44aaa87332f99229f89ff'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.352568 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:35.361252 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '814641bf0eb44aaa87332f99229f89ff'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.367441 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1388/2788] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:35 2022] DELETE /identity/v3/users/814641bf0eb44aaa87332f99229f89ff => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:35.372129 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:35.372702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:35.372702 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:35.392003 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:35.393189 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:35.451115 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1401/2789] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:35.460652 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:35.462665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:35.518767 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c328f7c0-1a73-443b-83b3-3d3697e57d83 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:35.522348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:35.522973 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:35.523258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:35.523555 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:35.532639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:35.534108 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:35.543467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1389/2790] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:35.814896 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:35.816355 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:35.831930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05abb521-73d1-440a-bb5d-566a71f20d75 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:35.838604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:35.839389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:35.839591 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:35.839920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] PATH_INFO: `/v3/projects/d635d2fd984247559dd011e2f4f855d0` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:35.841057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d635d2fd984247559dd011e2f4f855d0)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:35.842997 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:35.891060 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd635d2fd984247559dd011e2f4f855d0', 'request_id': 'req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.896442 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd635d2fd984247559dd011e2f4f855d0', 'request_id': 'req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.898070 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:35.903838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd635d2fd984247559dd011e2f4f855d0', 'request_id': 'req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.915885 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] The token cache is being invalidate because project d635d2fd984247559dd011e2f4f855d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:35.916178 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.916815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:35.918329 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1402/2791] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:35 2022] DELETE /identity/v3/projects/d635d2fd984247559dd011e2f4f855d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:35.922280 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:35.933545 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc796f0-9532-4144-9418-9fa37556c1f7 service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:35.990221 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:35.990885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:35.991192 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:35.991469 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] PATH_INFO: `/v3/users/98d3ceed6d4f473a88fe4d531eada9bb` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:35.993294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d3ceed6d4f473a88fe4d531eada9bb)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:35.995248 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.039945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d3ceed6d4f473a88fe4d531eada9bb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.051735 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d3ceed6d4f473a88fe4d531eada9bb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.059572 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d3ceed6d4f473a88fe4d531eada9bb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.060190 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d3ceed6d4f473a88fe4d531eada9bb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.066967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8739a407-2ad8-4ad8-9220-26abc38956d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d3ceed6d4f473a88fe4d531eada9bb'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.073084 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1390/2792] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:35 2022] DELETE /identity/v3/users/98d3ceed6d4f473a88fe4d531eada9bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:36.340072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.341498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:36.358976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a25a34-a125-46d4-b2a4-f145bd0f3b48 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.423924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.424607 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.424738 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.425011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] PATH_INFO: `/v3/projects/7118ad229d0b467390a14fba4906fc57` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.426114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7118ad229d0b467390a14fba4906fc57)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.428245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.472983 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7118ad229d0b467390a14fba4906fc57', 'request_id': 'req-1641f2fb-82a9-4859-8c91-eb7e9469bd74'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.478526 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7118ad229d0b467390a14fba4906fc57', 'request_id': 'req-1641f2fb-82a9-4859-8c91-eb7e9469bd74'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.485086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7118ad229d0b467390a14fba4906fc57', 'request_id': 'req-1641f2fb-82a9-4859-8c91-eb7e9469bd74'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.496585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] The token cache is being invalidate because project 7118ad229d0b467390a14fba4906fc57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:36.496883 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.497575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-1641f2fb-82a9-4859-8c91-eb7e9469bd74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:36.499141 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1403/2793] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:36 2022] DELETE /identity/v3/projects/7118ad229d0b467390a14fba4906fc57 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:36.503993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.504452 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.504590 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.524792 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:36.526016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:36.531584 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:36.585883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1391/2794] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:36.593729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.594021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.594326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.614261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:36.615514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:36.624209 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1404/2795] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:36.628344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.638024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4980f-63fe-4045-8936-889509ac0491 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.642507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.643142 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.643425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.643700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.644348 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:36:36.644659 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.646243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.658034 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1392/2796] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:36:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:36:36.662293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.672092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903066bf-3bd4-4077-b47e-5b13638c6cdd None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.676828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.677361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.677647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.677924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.678552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.680574 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.707913 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1405/2797] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:36 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:36.712776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.722665 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d1487b-1993-4fd6-ba3d-f940765b3fbe admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.777121 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.777829 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.778133 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.778406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.779435 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.781449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.801531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1393/2798] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:36 2022] POST /identity/v3/users => generated 278 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:36:36.805927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.816345 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3238fab6-880a-4b17-ac69-53f2a7d2ec45 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.821596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.822198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.822485 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.822795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.823446 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.825057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.834758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1406/2799] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:36.839410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.849239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187ed008-1a11-4fc9-9024-de3d92d5c024 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.853791 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fe5258-6344-4dd5-a0fa-0d45f95f8c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.854372 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5258-6344-4dd5-a0fa-0d45f95f8c6e admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.854656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5258-6344-4dd5-a0fa-0d45f95f8c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.854962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fe5258-6344-4dd5-a0fa-0d45f95f8c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.855716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe5258-6344-4dd5-a0fa-0d45f95f8c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.857298 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fe5258-6344-4dd5-a0fa-0d45f95f8c6e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.867616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1394/2800] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:36.871617 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:36.881659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57382c2c-7e3f-44a7-8c96-ae2f7e9b25f7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:36.887234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:36.887927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.888186 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.888547 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] PATH_INFO: `/v3/projects/f3faffa1291b4c2ab6c67e3dc28fdc2c/users/b7d44100652d4ab8ac17a360c9442f49/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.903518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3faffa1291b4c2ab6c67e3dc28fdc2c, user_id=b7d44100652d4ab8ac17a360c9442f49, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:36.906435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:36.919288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1407/2801] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:36 2022] PUT /identity/v3/projects/f3faffa1291b4c2ab6c67e3dc28fdc2c/users/b7d44100652d4ab8ac17a360c9442f49/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:36.930892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:36.931122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:36.931398 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:36.959111 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] MFA Rules not processed for user `b7d44100652d4ab8ac17a360c9442f49`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:36.960333 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:37.026136 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1395/2802] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:37.030869 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.044219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:37.093491 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cc6ba-dbc3-4c16-bb81-6305d413d170 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.098126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.098745 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.099030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.099300 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.099915 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.102444 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.127932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1408/2803] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:37 2022] POST /identity/v3/projects => generated 355 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:37.132158 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.142747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1dea5db-082f-4875-8526-63e2ac7914f3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.146266 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:37.202288 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.202865 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.203141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.203414 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.204044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.205948 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.227731 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1396/2804] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:37 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:37.231908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.242155 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f9dee6-ba07-40b2-bca9-b368957470b2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.246958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.247570 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.247842 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.248120 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.248766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.250370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.260728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1409/2805] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 17 23:36:37.264551 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.275051 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c675c5ae-3e92-43c1-a865-423308717ddd admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.279944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.280598 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.280883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.281161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] PATH_INFO: `/v3/projects/44030a86035a4a1f86f8449539302a97/users/951cfaf1f8614210b589fb14fdda106e/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.297381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44030a86035a4a1f86f8449539302a97, user_id=951cfaf1f8614210b589fb14fdda106e, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.300058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.312351 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1397/2806] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:37 2022] PUT /identity/v3/projects/44030a86035a4a1f86f8449539302a97/users/951cfaf1f8614210b589fb14fdda106e/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:37.316269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.326910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc0d146-6c0f-4aca-90ee-6ddf25c15bd1 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.383219 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f4ad34-9bc5-49f6-bf73-8717f38bfc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.384107 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4ad34-9bc5-49f6-bf73-8717f38bfc25 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.384410 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4ad34-9bc5-49f6-bf73-8717f38bfc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.384692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f4ad34-9bc5-49f6-bf73-8717f38bfc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.385340 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4ad34-9bc5-49f6-bf73-8717f38bfc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.387140 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f4ad34-9bc5-49f6-bf73-8717f38bfc25 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.396886 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1410/2807] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:37.401607 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.413312 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddb97e0-f8a3-45aa-a943-1b26bed3c37e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.418886 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.419588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.419846 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.420141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] PATH_INFO: `/v3/projects/44030a86035a4a1f86f8449539302a97/users/951cfaf1f8614210b589fb14fdda106e/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.422024 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44030a86035a4a1f86f8449539302a97, user_id=951cfaf1f8614210b589fb14fdda106e, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.424656 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.435429 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1398/2808] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:37 2022] PUT /identity/v3/projects/44030a86035a4a1f86f8449539302a97/users/951cfaf1f8614210b589fb14fdda106e/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:37.445717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.446198 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.446309 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.473392 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] MFA Rules not processed for user `951cfaf1f8614210b589fb14fdda106e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:37.474532 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:37.542194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1411/2809] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:37 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:37.553370 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.555778 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:37.611495 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cb1afd-5f8b-4f43-9474-01d5cd92a261 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.615072 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.615666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.615942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.616236 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.625984 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.627424 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.636851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1399/2810] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:37 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:37.714156 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:37.723781 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319d613-f54e-4df2-b056-4ea7cb321f39 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:37.727860 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8b66-44ac-4332-9560-6e1ce2046399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:37.728468 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8b66-44ac-4332-9560-6e1ce2046399 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:37.728795 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8b66-44ac-4332-9560-6e1ce2046399 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:37.729093 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8b66-44ac-4332-9560-6e1ce2046399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:37.734594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:37.786426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8b66-44ac-4332-9560-6e1ce2046399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:37.788057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8b66-44ac-4332-9560-6e1ce2046399 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:37.797332 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1412/2811] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:47.632489 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=67,keystone:INSERT=5 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:47.793289 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=24 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:52.547042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:52.609016 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271bd0e3-3add-4fa1-838f-23dd0a7d4c31 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:52.613515 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:52.614169 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:52.614454 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:52.614755 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] PATH_INFO: `/v3/users/b7d44100652d4ab8ac17a360c9442f49` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:52.615875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d44100652d4ab8ac17a360c9442f49)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:52.617996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:52.665625 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d44100652d4ab8ac17a360c9442f49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:52.677199 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d44100652d4ab8ac17a360c9442f49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:52.684963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d44100652d4ab8ac17a360c9442f49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:52.685586 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d44100652d4ab8ac17a360c9442f49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:52.692632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d44100652d4ab8ac17a360c9442f49'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:52.698601 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1400/2812] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:52 2022] DELETE /identity/v3/users/b7d44100652d4ab8ac17a360c9442f49 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:52.703057 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:52.703542 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:52.703652 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:52.723816 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:52.724963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:52.783765 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1413/2813] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:52.793700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:52.795141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:52.850980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba170a2-9b28-473a-922f-755fbaf9d6ae admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:52.854839 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:52.855471 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:52.855756 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:52.856032 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:52.865067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:52.866496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:52.876265 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1401/2814] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:53.139926 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:53.141536 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:53.154376 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf1188-19b8-4482-9ae1-6b8119d30701 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:53.158946 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:53.159585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.159867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.160143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] PATH_INFO: `/v3/projects/f3faffa1291b4c2ab6c67e3dc28fdc2c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.161383 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3faffa1291b4c2ab6c67e3dc28fdc2c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:53.163349 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:53.209799 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3faffa1291b4c2ab6c67e3dc28fdc2c', 'request_id': 'req-5331ac43-3d5c-46c8-b50b-764b9c1527c7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.215382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3faffa1291b4c2ab6c67e3dc28fdc2c', 'request_id': 'req-5331ac43-3d5c-46c8-b50b-764b9c1527c7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.222669 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3faffa1291b4c2ab6c67e3dc28fdc2c', 'request_id': 'req-5331ac43-3d5c-46c8-b50b-764b9c1527c7'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.234439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] The token cache is being invalidate because project f3faffa1291b4c2ab6c67e3dc28fdc2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:53.234752 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.235379 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.236875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1414/2815] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:53 2022] DELETE /identity/v3/projects/f3faffa1291b4c2ab6c67e3dc28fdc2c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:53.240934 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:53.251411 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb17ad0-5b02-4a28-b6ae-1c491afdf12d service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:53.269119 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:53.309181 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:53.309836 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.310110 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.310382 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] PATH_INFO: `/v3/users/951cfaf1f8614210b589fb14fdda106e` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.311514 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=951cfaf1f8614210b589fb14fdda106e)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:53.313423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:53.358179 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '951cfaf1f8614210b589fb14fdda106e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.370570 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '951cfaf1f8614210b589fb14fdda106e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.377746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '951cfaf1f8614210b589fb14fdda106e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.378534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '951cfaf1f8614210b589fb14fdda106e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.385729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0a11230c-79de-4edd-b748-b3de59cf0ec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '951cfaf1f8614210b589fb14fdda106e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.391510 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1402/2816] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:53 2022] DELETE /identity/v3/users/951cfaf1f8614210b589fb14fdda106e => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:53.660201 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:53.661677 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:53.675728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5331ac43-3d5c-46c8-b50b-764b9c1527c7 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:53.732590 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:53.733431 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.733575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.733772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] PATH_INFO: `/v3/projects/44030a86035a4a1f86f8449539302a97` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.734942 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44030a86035a4a1f86f8449539302a97)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:53.736855 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:53.765823 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:53.784353 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44030a86035a4a1f86f8449539302a97', 'request_id': 'req-fd775d01-6f84-420e-a614-cceb188ca8d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.790717 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44030a86035a4a1f86f8449539302a97', 'request_id': 'req-fd775d01-6f84-420e-a614-cceb188ca8d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.798290 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44030a86035a4a1f86f8449539302a97', 'request_id': 'req-fd775d01-6f84-420e-a614-cceb188ca8d3'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.809492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] The token cache is being invalidate because project 44030a86035a4a1f86f8449539302a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:53.809812 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.810443 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fd775d01-6f84-420e-a614-cceb188ca8d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:53.811953 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1415/2817] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:53 2022] DELETE /identity/v3/projects/44030a86035a4a1f86f8449539302a97 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:53.816879 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.817352 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.817462 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.837688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:53.838923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:53.899617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1403/2818] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:53.908729 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.909016 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.909295 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.928473 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:53.929671 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:53.937735 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1416/2819] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:36:53.941903 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:53.952058 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3434d0-1d41-4f6c-8e86-8b125aad6559 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:53.956529 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:53.957115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.957393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.957664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.958308 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:36:53.958608 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:53.960210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:53.972145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1404/2820] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:36:53.976165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:53.985559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1089e739-7454-46b2-829f-d437f9b48047 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:53.990204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:53.990828 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:53.991114 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:53.991390 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:53.992040 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:53.994122 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.031633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1417/2821] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:53 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:54.035809 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.046012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c119eef-2e79-4228-b081-04310a94ae5f admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.072237 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:54.103945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.104543 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.104824 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.105094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.105747 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.107710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.127944 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1405/2822] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:54 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:54.131985 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.143017 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45d893c-48c0-40bd-a165-4dff6df9183c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.147635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.148231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.148579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.149815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.150458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.152087 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.161991 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1418/2823] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:54.166306 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.176204 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8d36b9-b4e1-4644-ba33-ff23ffb48944 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.181423 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d622a7f5-90af-435a-86f5-4f66ec4c52ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.182011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a7f5-90af-435a-86f5-4f66ec4c52ef admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.182293 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a7f5-90af-435a-86f5-4f66ec4c52ef admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.182569 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d622a7f5-90af-435a-86f5-4f66ec4c52ef admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.183240 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a7f5-90af-435a-86f5-4f66ec4c52ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.184816 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d622a7f5-90af-435a-86f5-4f66ec4c52ef admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.196773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1406/2824] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:54.200922 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.210977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efdbd01-bda9-40e6-bbcb-2acca9e4fde2 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.215822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.216471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.216758 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.217042 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] PATH_INFO: `/v3/projects/139b0b83f7fd46d2a752157b87967a79/users/90e09bd881aa4cf18224e8c6868c5da0/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.232549 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=139b0b83f7fd46d2a752157b87967a79, user_id=90e09bd881aa4cf18224e8c6868c5da0, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.235282 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.249580 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1419/2825] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:54 2022] PUT /identity/v3/projects/139b0b83f7fd46d2a752157b87967a79/users/90e09bd881aa4cf18224e8c6868c5da0/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:54.260439 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.260722 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.260993 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.289002 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] MFA Rules not processed for user `90e09bd881aa4cf18224e8c6868c5da0`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:54.290269 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:54.354056 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1407/2826] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:54.358585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.419585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a608314-b939-4956-b149-f510bae5fc88 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.424583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.425190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.425471 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.425746 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.426367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.428321 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.455381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1420/2827] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:54 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:54.459446 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.470078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308204dd-02f5-46f6-b7cd-c824616251d7 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.524935 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.525530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.525815 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.526089 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.526738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.528662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.548291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1408/2828] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:54 2022] POST /identity/v3/users => generated 300 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:54.552207 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.562963 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fbb70f-335c-4b88-804b-5aacab7d998b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.567595 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.568190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.568470 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.568744 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.569382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.571618 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.581875 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1421/2829] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:54.585852 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.595905 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca328d9a-337f-440c-9409-fd78c8ee42ae admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.600563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.601210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.601492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.602442 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] PATH_INFO: `/v3/projects/536c9fafd3a442bcada82c165f1a018a/users/9ca3c73d449945f88cf1029ce9187b6c/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.616771 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c9fafd3a442bcada82c165f1a018a, user_id=9ca3c73d449945f88cf1029ce9187b6c, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.620062 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.632208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1409/2830] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:54 2022] PUT /identity/v3/projects/536c9fafd3a442bcada82c165f1a018a/users/9ca3c73d449945f88cf1029ce9187b6c/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:36:54.636296 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.646095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb305c5-f325-4fc8-a711-a4d8393d8492 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.657634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:54.704742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd65fd-56ba-4bda-b9a8-331f01ab3d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.705351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd65fd-56ba-4bda-b9a8-331f01ab3d56 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.705635 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd65fd-56ba-4bda-b9a8-331f01ab3d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.705910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd65fd-56ba-4bda-b9a8-331f01ab3d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.706556 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd65fd-56ba-4bda-b9a8-331f01ab3d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.708194 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd65fd-56ba-4bda-b9a8-331f01ab3d56 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.719024 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1422/2831] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:54.723068 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.728768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:54.735980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a702cba8-210f-4444-82aa-3c9edb6709c0 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.740716 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.741360 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.741639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.741910 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] PATH_INFO: `/v3/projects/536c9fafd3a442bcada82c165f1a018a/users/9ca3c73d449945f88cf1029ce9187b6c/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.743974 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=536c9fafd3a442bcada82c165f1a018a, user_id=9ca3c73d449945f88cf1029ce9187b6c, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.746575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.756531 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1410/2832] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:54 2022] PUT /identity/v3/projects/536c9fafd3a442bcada82c165f1a018a/users/9ca3c73d449945f88cf1029ce9187b6c/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:54.767205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.767675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.767805 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.795648 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] MFA Rules not processed for user `9ca3c73d449945f88cf1029ce9187b6c`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:54.796944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:54.864575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1423/2833] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:54.875634 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:54.877289 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:54.935550 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc80257-40f4-4bd9-af47-2450571c35c9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:54.939130 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616a899f-5a44-4c19-8c3f-8a4ed4f8550c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:54.939736 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a899f-5a44-4c19-8c3f-8a4ed4f8550c service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:54.940019 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a899f-5a44-4c19-8c3f-8a4ed4f8550c service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:54.940291 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616a899f-5a44-4c19-8c3f-8a4ed4f8550c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:54.949466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a899f-5a44-4c19-8c3f-8a4ed4f8550c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:54.950914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616a899f-5a44-4c19-8c3f-8a4ed4f8550c service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:54.960205 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1411/2834] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:54 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:54.992175 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:55.053508 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1a5d2d-8011-4ef3-8f81-63ffbcc4feb7 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:55.058061 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:55.058809 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:55.059094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:55.059367 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] PATH_INFO: `/v3/users/90e09bd881aa4cf18224e8c6868c5da0` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:55.060483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90e09bd881aa4cf18224e8c6868c5da0)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:55.062391 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:55.100604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:55.107683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90e09bd881aa4cf18224e8c6868c5da0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.108400 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90e09bd881aa4cf18224e8c6868c5da0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.120804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90e09bd881aa4cf18224e8c6868c5da0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.128217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90e09bd881aa4cf18224e8c6868c5da0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.135535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90e09bd881aa4cf18224e8c6868c5da0'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.141429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1424/2835] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:54 2022] DELETE /identity/v3/users/90e09bd881aa4cf18224e8c6868c5da0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:55.145978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:55.146267 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:55.146541 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:55.166319 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:55.167539 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:55.223966 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1412/2836] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:55.234474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:55.236008 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:55.293581 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6641c86-bcf6-4c12-bfbd-da124d12db86 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:55.297280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:55.297892 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:55.298176 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:55.298453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:55.307465 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:55.308901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:55.318205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1425/2837] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:55.593235 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:55.594692 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:55.607496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa0d874-0c66-46d5-99b7-f57fce766458 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:55.612187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:55.612820 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:55.613101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:55.613378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] PATH_INFO: `/v3/projects/139b0b83f7fd46d2a752157b87967a79` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:55.614526 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] RBAC: Authorizing `identity:delete_project(project_id=139b0b83f7fd46d2a752157b87967a79)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:55.616546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:55.664641 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '139b0b83f7fd46d2a752157b87967a79', 'request_id': 'req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.670082 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '139b0b83f7fd46d2a752157b87967a79', 'request_id': 'req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.677343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '139b0b83f7fd46d2a752157b87967a79', 'request_id': 'req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.689012 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] The token cache is being invalidate because project 139b0b83f7fd46d2a752157b87967a79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:55.689303 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.689955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.691449 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1413/2838] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:55 2022] DELETE /identity/v3/projects/139b0b83f7fd46d2a752157b87967a79 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:36:55.695583 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:55.705395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c223af0-f438-4cd8-988c-7df5053a44a2 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:55.761609 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:55.762234 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:55.762518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:55.762836 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] PATH_INFO: `/v3/users/9ca3c73d449945f88cf1029ce9187b6c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:55.763948 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ca3c73d449945f88cf1029ce9187b6c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:55.765905 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:55.810867 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ca3c73d449945f88cf1029ce9187b6c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.811492 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ca3c73d449945f88cf1029ce9187b6c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.821462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:55.824092 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ca3c73d449945f88cf1029ce9187b6c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.831935 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ca3c73d449945f88cf1029ce9187b6c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.839740 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-f8715aa2-c971-4465-88d9-d53f0af92e4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ca3c73d449945f88cf1029ce9187b6c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:55.845458 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1426/2839] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:36:55 2022] DELETE /identity/v3/users/9ca3c73d449945f88cf1029ce9187b6c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:56.115230 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.116730 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:56.130059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5c01e8-8638-4e0e-b997-73dc647a5cbd admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.144322 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:56.191332 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.191980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.192255 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.192530 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] PATH_INFO: `/v3/projects/536c9fafd3a442bcada82c165f1a018a` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.193697 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=536c9fafd3a442bcada82c165f1a018a)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.196239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.245187 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '536c9fafd3a442bcada82c165f1a018a', 'request_id': 'req-4db04869-996a-4632-ad01-274c6e10b6a7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:56.250632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '536c9fafd3a442bcada82c165f1a018a', 'request_id': 'req-4db04869-996a-4632-ad01-274c6e10b6a7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:56.257684 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '536c9fafd3a442bcada82c165f1a018a', 'request_id': 'req-4db04869-996a-4632-ad01-274c6e10b6a7'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:56.269431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] The token cache is being invalidate because project 536c9fafd3a442bcada82c165f1a018a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:36:56.269726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:56.270381 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-4db04869-996a-4632-ad01-274c6e10b6a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:36:56.271921 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1414/2840] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:36:56 2022] DELETE /identity/v3/projects/536c9fafd3a442bcada82c165f1a018a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:56.277029 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.277327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.277624 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.298027 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:56.299262 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:56.358305 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1427/2841] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:56.420098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.420415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.420695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.442415 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:56.443666 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:56.451960 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1415/2842] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:56.456263 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.466480 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb1aa1b-7961-4184-a34d-9842bd8d669f None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.471210 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.471814 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.472098 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.472374 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.473030 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:36:56.473336 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.474978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.487494 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1428/2843] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:36:56.491380 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.501026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ce4e0-c902-41e4-8033-171a66f85de3 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.505675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.506302 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.506580 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.506892 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.508134 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.510383 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.540831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1416/2844] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:56.544988 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.555506 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae69716-3b27-4485-9921-2a40e8a06a9c admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.614276 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.614927 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.615217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.615495 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.616256 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.618381 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.642246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1429/2845] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 17 23:36:56.643664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.655026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67784a19-b688-4787-9b1a-5de7420badfe admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.659729 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.660345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.660629 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.660906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.661558 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.663193 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.673885 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1417/2846] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:56.678056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.689288 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b944c8-c66b-43e6-85ac-da6364e9afb8 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.694269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268bef9e-0125-4a21-ab52-1568ef2ed2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.694908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bef9e-0125-4a21-ab52-1568ef2ed2ed admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.695195 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bef9e-0125-4a21-ab52-1568ef2ed2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.696035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268bef9e-0125-4a21-ab52-1568ef2ed2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.696845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bef9e-0125-4a21-ab52-1568ef2ed2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.698445 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268bef9e-0125-4a21-ab52-1568ef2ed2ed admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.709535 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1430/2847] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:56.713706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.723963 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7a5d34-b28c-4636-af9e-d331e590bbd4 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.728857 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.729677 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.729800 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.730083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] PATH_INFO: `/v3/projects/34c1d07d9776493d85a16773b321c0e7/users/89c17e9210674299849ce843c079ac4f/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.746967 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34c1d07d9776493d85a16773b321c0e7, user_id=89c17e9210674299849ce843c079ac4f, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.749657 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.763868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1418/2848] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:56 2022] PUT /identity/v3/projects/34c1d07d9776493d85a16773b321c0e7/users/89c17e9210674299849ce843c079ac4f/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:36:56.773798 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.774162 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.774530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.802316 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] MFA Rules not processed for user `89c17e9210674299849ce843c079ac4f`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:56.803585 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:56.837521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:56.876703 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1431/2849] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:56.881200 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:56.930444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:56.950431 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d6bf8-e513-4220-9dd4-23df52bfe5a5 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:56.955167 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:56.955776 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:56.956052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:56.956320 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:56.956956 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:56.958875 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:56.988073 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1419/2850] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/projects => generated 381 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:56.989230 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.001231 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48971ecc-1520-4085-8e22-b0e47b2502f0 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.060968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.061683 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.061968 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.062246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.062918 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.064838 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.088564 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1432/2851] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:36:56 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:36:57.092294 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.102683 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab9f638-abeb-4c70-8ce5-6be80e32cd24 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.107261 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.107856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.108139 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.108413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.109054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.110644 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.123695 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1420/2852] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:57.127854 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.138395 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08921ff-8188-437c-8b2e-e0496c800975 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.143080 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.143734 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.144021 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.144298 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] PATH_INFO: `/v3/projects/bcfeb4a6f4eb4b269d826798f452fb82/users/0341e958b53349ada36998a85bd7f22c/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.159579 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfeb4a6f4eb4b269d826798f452fb82, user_id=0341e958b53349ada36998a85bd7f22c, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.162243 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.175083 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1433/2853] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:57 2022] PUT /identity/v3/projects/bcfeb4a6f4eb4b269d826798f452fb82/users/0341e958b53349ada36998a85bd7f22c/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:57.178996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.189898 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469354cb-83be-49a5-8b18-8cde4af02301 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.245081 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea1f062-1c8e-43d3-944b-093e70492b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.245593 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f062-1c8e-43d3-944b-093e70492b61 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.245871 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f062-1c8e-43d3-944b-093e70492b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.246141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea1f062-1c8e-43d3-944b-093e70492b61 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.246805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1f062-1c8e-43d3-944b-093e70492b61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.248385 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea1f062-1c8e-43d3-944b-093e70492b61 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.258784 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1421/2854] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:36:57.263283 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.273647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d904140-6877-4578-998c-ef65839f8d11 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.279573 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.280240 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.280518 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.280789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] PATH_INFO: `/v3/projects/bcfeb4a6f4eb4b269d826798f452fb82/users/0341e958b53349ada36998a85bd7f22c/roles/585c0d47a790421289bad938a0377b4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.282695 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfeb4a6f4eb4b269d826798f452fb82, user_id=0341e958b53349ada36998a85bd7f22c, role_id=585c0d47a790421289bad938a0377b4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.285411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.296143 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1434/2855] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:36:57 2022] PUT /identity/v3/projects/bcfeb4a6f4eb4b269d826798f452fb82/users/0341e958b53349ada36998a85bd7f22c/roles/585c0d47a790421289bad938a0377b4f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:36:57.306662 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.306978 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.307258 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.334841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] MFA Rules not processed for user `0341e958b53349ada36998a85bd7f22c`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:36:57.336057 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:57.402508 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1422/2856] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:36:57 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:36:57.413832 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.415851 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:36:57.472660 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb33b35-0eb7-4d54-a2b7-4e751474659b admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.476212 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.477010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.477502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.477785 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.486598 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.488055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.498148 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1435/2857] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:57 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:36:57.599565 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:36:57.609606 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddacd0-7ad4-41a6-9c5a-f32e7ebdef36 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:36:57.613127 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011d8e1-e39b-4160-9ba2-325897a92119 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:36:57.613719 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011d8e1-e39b-4160-9ba2-325897a92119 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:36:57.613996 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011d8e1-e39b-4160-9ba2-325897a92119 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:36:57.614264 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011d8e1-e39b-4160-9ba2-325897a92119 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:36:57.646507 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:36:57.673621 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011d8e1-e39b-4160-9ba2-325897a92119 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:36:57.675152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011d8e1-e39b-4160-9ba2-325897a92119 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:36:57.684828 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1423/2858] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:36:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:00.258910 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:00.290068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:00.323009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc6e13-43aa-4a01-9dbd-e7f468260455 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:00.327596 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:00.328258 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:00.328543 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:00.328822 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] PATH_INFO: `/v3/users/89c17e9210674299849ce843c079ac4f` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:00.329977 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89c17e9210674299849ce843c079ac4f)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:00.331939 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:00.377519 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89c17e9210674299849ce843c079ac4f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.378168 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89c17e9210674299849ce843c079ac4f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.390610 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89c17e9210674299849ce843c079ac4f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.398011 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89c17e9210674299849ce843c079ac4f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.405269 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89c17e9210674299849ce843c079ac4f'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.411474 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1436/2859] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:37:00 2022] DELETE /identity/v3/users/89c17e9210674299849ce843c079ac4f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:00.416186 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:00.416663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:00.416773 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:00.437548 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:00.438807 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:00.496991 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1424/2860] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:37:00.506521 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:00.508566 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:00.564457 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ce9ce-5eaa-4cdf-ba3b-6fe923bf52b0 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:00.568117 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:00.568722 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:00.569009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:00.569285 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:00.578930 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:00.580360 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:00.589686 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1437/2861] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:00.867831 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:00.869344 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:00.881324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a65b8ad-eddb-41c1-b395-9fe347260ed2 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:00.886841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:00.887670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:00.887670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:00.888039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] PATH_INFO: `/v3/projects/34c1d07d9776493d85a16773b321c0e7` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:00.889202 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34c1d07d9776493d85a16773b321c0e7)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:00.891146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:00.939664 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34c1d07d9776493d85a16773b321c0e7', 'request_id': 'req-16f58fdf-3ca9-4a66-985f-0ff184163cf9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.945152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34c1d07d9776493d85a16773b321c0e7', 'request_id': 'req-16f58fdf-3ca9-4a66-985f-0ff184163cf9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.952700 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34c1d07d9776493d85a16773b321c0e7', 'request_id': 'req-16f58fdf-3ca9-4a66-985f-0ff184163cf9'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.964103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] The token cache is being invalidate because project 34c1d07d9776493d85a16773b321c0e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:37:00.964392 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.965074 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:00.966547 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1425/2862] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:37:00 2022] DELETE /identity/v3/projects/34c1d07d9776493d85a16773b321c0e7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:00.970552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:00.980964 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be55c8-4bf2-404b-805b-3e5af840b2c8 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.027220 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:01.038078 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.038719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.039009 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.040062 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] PATH_INFO: `/v3/users/0341e958b53349ada36998a85bd7f22c` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.041325 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0341e958b53349ada36998a85bd7f22c)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.043314 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.088052 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0341e958b53349ada36998a85bd7f22c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.088741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0341e958b53349ada36998a85bd7f22c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.100594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0341e958b53349ada36998a85bd7f22c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.108510 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0341e958b53349ada36998a85bd7f22c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.115361 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0341e958b53349ada36998a85bd7f22c'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.121493 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1438/2863] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:37:00 2022] DELETE /identity/v3/users/0341e958b53349ada36998a85bd7f22c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:01.399534 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:01.401044 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:01.428648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58fdf-3ca9-4a66-985f-0ff184163cf9 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.474202 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:01.475772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:01.504094 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.504801 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.505174 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.505460 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] PATH_INFO: `/v3/projects/bcfeb4a6f4eb4b269d826798f452fb82` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.506660 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfeb4a6f4eb4b269d826798f452fb82)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.509386 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.511403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:01.546967 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc44b8ce-5f67-46fc-ac48-e2bceab40c89 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.551095 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.551845 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.552133 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.552550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.554558 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:01.566987 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfeb4a6f4eb4b269d826798f452fb82', 'request_id': 'req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.574209 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfeb4a6f4eb4b269d826798f452fb82', 'request_id': 'req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.584479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfeb4a6f4eb4b269d826798f452fb82', 'request_id': 'req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.599639 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] The token cache is being invalidate because project bcfeb4a6f4eb4b269d826798f452fb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:37:01.599977 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.600983 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-a18d7882-f3b4-4d5e-9f88-9b6f7e6ec012 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:01.602744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1426/2864] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:37:01 2022] DELETE /identity/v3/projects/bcfeb4a6f4eb4b269d826798f452fb82 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:01.607900 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.608737 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.609226 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.634689 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:01.636080 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:01.655347 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.656889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c62776-108b-4d34-a7c7-1bd0155351c9 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.665970 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:01.672094 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1439/2865] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 17 23:37:01.706805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1427/2866] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:37:01.716733 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.717214 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.717504 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.742882 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:01.744594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:01.753261 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1440/2867] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:37:01.758115 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:01.769078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea8803-5bf3-4abf-88e8-6c8d36483748 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.775761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.776710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.777647 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.778339 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] PATH_INFO: `/v3/domains` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.779524 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85576) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:37:01.780023 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.782141 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.798779 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1428/2868] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:37:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:37:01.801126 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:01.811056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951bfee1-f3d0-4c96-ab25-b964a915c433 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.816167 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.816791 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.817074 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.817354 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] PATH_INFO: `/v3/projects` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.817980 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.819921 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.853284 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1441/2869] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:37:01 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:37:01.855682 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:01.865833 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfcbba4-31d5-4135-bd4d-6db528dc9892 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.926694 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.927334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.927620 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.928017 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] PATH_INFO: `/v3/users` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.928663 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.931146 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.952923 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1429/2870] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:37:01 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:37:01.957035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:01.968163 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459f1c4c-1567-4a2b-8fac-eb0483c49e20 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:01.973086 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:01.973766 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:01.974055 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:01.974335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:01.975018 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:01.977217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:01.987861 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1442/2871] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:37:01.991861 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:02.002098 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac7e36b-2f51-4518-b44d-69cc7b055a79 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:02.007241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cd65c-e24a-46bb-8a6f-b1fa9074cf5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:02.008011 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cd65c-e24a-46bb-8a6f-b1fa9074cf5b admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:02.008358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cd65c-e24a-46bb-8a6f-b1fa9074cf5b admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:02.008711 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cd65c-e24a-46bb-8a6f-b1fa9074cf5b admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:02.009537 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cd65c-e24a-46bb-8a6f-b1fa9074cf5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:02.011953 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cd65c-e24a-46bb-8a6f-b1fa9074cf5b admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:02.014246 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:02.029880 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1430/2872] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:37:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:37:02.031268 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:02.042264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a8da0d-8331-445f-91d2-448bcc92e1eb admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:02.046889 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:02.047550 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] REQUEST_METHOD: `PUT` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:02.047835 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:02.048113 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] PATH_INFO: `/v3/projects/5c8a3b013ad54b48b39dcac08b160915/users/9a965a31b23044208e0cb5b2c8cbc434/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:02.063690 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c8a3b013ad54b48b39dcac08b160915, user_id=9a965a31b23044208e0cb5b2c8cbc434, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:02.066462 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:02.080224 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1443/2873] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:37:02 2022] PUT /identity/v3/projects/5c8a3b013ad54b48b39dcac08b160915/users/9a965a31b23044208e0cb5b2c8cbc434/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:02.090430 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:02.090749 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:02.091031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:02.120761 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] MFA Rules not processed for user `9a965a31b23044208e0cb5b2c8cbc434`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:02.121980 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:02.186401 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1431/2874] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:02.198025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:02.199924 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:02.258833 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50c7be-ff4f-427e-8c69-b7a287fdea21 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:02.262565 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:02.263213 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:02.263497 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:02.263777 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:02.272032 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:02.274081 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:02.283608 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1444/2875] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:02 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:02.886343 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:02.887821 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:02.947270 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eabac9e-0a90-4182-9633-34e60c068ac5 None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:02.950856 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:02.951458 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:02.951740 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:02.952014 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:02.953704 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:03.026048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:03.027535 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370caf33-8862-4055-8620-33f414c5b6fc service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:03.038858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1432/2876] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:07.618034 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:07.685217 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aef63f-fd54-4e61-b854-76824e15b0d2 service cinder] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:07.689741 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:07.690370 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:07.690653 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:07.690957 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] PATH_INFO: `/v3/users/9a965a31b23044208e0cb5b2c8cbc434` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:07.692072 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a965a31b23044208e0cb5b2c8cbc434)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:07.693999 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:07.736958 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:07.742871 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a965a31b23044208e0cb5b2c8cbc434'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:07.744327 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a965a31b23044208e0cb5b2c8cbc434'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:07.756464 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a965a31b23044208e0cb5b2c8cbc434'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:07.764634 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a965a31b23044208e0cb5b2c8cbc434'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:07.773104 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a965a31b23044208e0cb5b2c8cbc434'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:07.780165 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1445/2877] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:37:07 2022] DELETE /identity/v3/users/9a965a31b23044208e0cb5b2c8cbc434 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:07.784837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:07.785334 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:07.785588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:07.806410 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:07.807680 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:07.830208 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:07.872496 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1433/2878] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:07.882578 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:07.884647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:07.943049 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c3ef6b-d37d-465f-a5ab-25449cd4fd65 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:07.947426 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894c78e5-6676-4a50-bef5-e9f9daae2b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:07.948056 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c78e5-6676-4a50-bef5-e9f9daae2b77 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:07.948346 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c78e5-6676-4a50-bef5-e9f9daae2b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:07.948622 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894c78e5-6676-4a50-bef5-e9f9daae2b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:07.957625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c78e5-6676-4a50-bef5-e9f9daae2b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:07.959111 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894c78e5-6676-4a50-bef5-e9f9daae2b77 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:07.968966 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1446/2879] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:08.235101 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.236575 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:08.250020 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dfcb2-bd79-4cbc-95b0-22fe84d8638b None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.254691 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.255418 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.255768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.256104 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] PATH_INFO: `/v3/projects/5c8a3b013ad54b48b39dcac08b160915` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.257283 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c8a3b013ad54b48b39dcac08b160915)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.259368 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.308883 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c8a3b013ad54b48b39dcac08b160915', 'request_id': 'req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:08.314311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c8a3b013ad54b48b39dcac08b160915', 'request_id': 'req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:08.321063 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c8a3b013ad54b48b39dcac08b160915', 'request_id': 'req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:08.332425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] The token cache is being invalidate because project 5c8a3b013ad54b48b39dcac08b160915 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:37:08.332710 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:08.333338 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8b75c0ab-b1fc-47b8-a41b-f3390a83f4db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:08.334841 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1434/2880] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:37:08 2022] DELETE /identity/v3/projects/5c8a3b013ad54b48b39dcac08b160915 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:37:08.340326 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.340615 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.340890 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.360530 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:08.361667 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:08.421808 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1447/2881] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:08.430675 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.431052 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.431330 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.450604 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:08.451863 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:08.459670 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1435/2882] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:08.464435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.474185 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c591ee0-182d-4610-abba-8bcb599fb098 None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.479626 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.480222 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.480502 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.480804 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] PATH_INFO: `/v3/domains` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.481453 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=85577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 17 23:37:08.481756 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.483389 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.494976 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1448/2883] 10.222.0.39 () {58 vars in 1153 bytes} [Wed Aug 17 23:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 17 23:37:08.499054 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.508259 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3cb6e-4bbb-4673-b208-c9d6f57a635e None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.512906 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.513502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.513786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.514059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] PATH_INFO: `/v3/projects` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.514726 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.516610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.544393 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1436/2884] 10.222.0.39 () {60 vars in 1153 bytes} [Wed Aug 17 23:37:08 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:37:08.548541 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.559454 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc73d9fe-043e-4cef-a59b-35300444a424 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.603248 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:08.616893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.617435 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.617742 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.618555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] PATH_INFO: `/v3/users` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.619294 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.621259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.641893 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1449/2885] 10.222.0.39 () {60 vars in 1144 bytes} [Wed Aug 17 23:37:08 2022] POST /identity/v3/users => generated 288 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 17 23:37:08.646026 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.658177 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6772f80c-20ed-4f34-af9b-0051171d2d5c admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.662715 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.663309 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.663588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.663858 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] PATH_INFO: `/v3/roles` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.664492 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.666310 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.675958 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1437/2886] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:37:08.679670 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.690208 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d853ed6f-16f4-41c6-8dd6-1fdfcce32e82 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.694829 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe85e0d-a8a9-4d89-b208-a495cb15b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.695427 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85e0d-a8a9-4d89-b208-a495cb15b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.695713 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85e0d-a8a9-4d89-b208-a495cb15b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.695994 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe85e0d-a8a9-4d89-b208-a495cb15b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.697280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe85e0d-a8a9-4d89-b208-a495cb15b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.698944 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe85e0d-a8a9-4d89-b208-a495cb15b5ab admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.709335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1450/2887] 10.222.0.39 () {58 vars in 1122 bytes} [Wed Aug 17 23:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 17 23:37:08.713637 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.723403 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab7b9b1-0eae-4fc7-95e8-1db4ce59e790 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.728324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.728962 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.729241 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.729511 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] PATH_INFO: `/v3/projects/19d3db7daead4d56a6a47ccf7898d98f/users/fa47724d4df6499f8a43e94a1f444bfc/roles/63bab4de085f498f963ba60424cdcde1` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.745152 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d3db7daead4d56a6a47ccf7898d98f, user_id=fa47724d4df6499f8a43e94a1f444bfc, role_id=63bab4de085f498f963ba60424cdcde1)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.747837 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.760876 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1438/2888] 10.222.0.39 () {60 vars in 1483 bytes} [Wed Aug 17 23:37:08 2022] PUT /identity/v3/projects/19d3db7daead4d56a6a47ccf7898d98f/users/fa47724d4df6499f8a43e94a1f444bfc/roles/63bab4de085f498f963ba60424cdcde1 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:08.771109 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64933-e147-4d61-8730-971e9c1533d8 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.771429 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64933-e147-4d61-8730-971e9c1533d8 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.771710 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d64933-e147-4d61-8730-971e9c1533d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.799992 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-53d64933-e147-4d61-8730-971e9c1533d8 None None] MFA Rules not processed for user `fa47724d4df6499f8a43e94a1f444bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:08.801246 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-53d64933-e147-4d61-8730-971e9c1533d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:08.865483 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1451/2889] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 17 23:37:08.876851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:08.878546 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:08.929955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:08.936566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b50d61-6dc2-493f-818e-a22680c45d45 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:08.941138 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8a1775415549435c96a6e22ff0fd6911', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:08.941746 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:08.942092 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:08.942377 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:08.952902 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:08.954364 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:08.963425 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1439/2890] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:10.325940 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4da6-c61d-46f2-9e57-afc0bc6c6d8f None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:10.326440 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4da6-c61d-46f2-9e57-afc0bc6c6d8f None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:10.326537 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee4da6-c61d-46f2-9e57-afc0bc6c6d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:10.345728 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-2cee4da6-c61d-46f2-9e57-afc0bc6c6d8f None None] MFA Rules not processed for user `fa47724d4df6499f8a43e94a1f444bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:10.346945 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-2cee4da6-c61d-46f2-9e57-afc0bc6c6d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:10.353830 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1452/2891] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:18.959324 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=5 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:20.341091 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:20.952632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:20.954042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:21.011038 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5615117c-b362-408d-9a1f-50c189a9e2d9 service cinder] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:21.014759 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:21.015378 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:21.015686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:21.015961 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:21.017706 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:21.028764 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:21.030459 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:21.039067 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1440/2892] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:26.657068 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5762-6f31-4a24-8f79-4e9149fed1ad None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:26.657546 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5762-6f31-4a24-8f79-4e9149fed1ad None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:26.657712 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f5762-6f31-4a24-8f79-4e9149fed1ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:26.705625 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-da7f5762-6f31-4a24-8f79-4e9149fed1ad None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:26.706864 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-da7f5762-6f31-4a24-8f79-4e9149fed1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:26.771366 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1453/2893] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:37:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:26.811768 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:26.813145 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:26.900667 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48057e-0718-402e-8bd8-bc26b939eecf service neutron] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:26.905873 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:26.906466 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:26.906772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:26.907048 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:26.915907 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:26.917477 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:26.925297 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1441/2894] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:37:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:37:27.422545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16b56-b17a-418e-ae2c-5c8c7cf3ce20 None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:27.422545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16b56-b17a-418e-ae2c-5c8c7cf3ce20 None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:27.422545 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb16b56-b17a-418e-ae2c-5c8c7cf3ce20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:27.442205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-0fb16b56-b17a-418e-ae2c-5c8c7cf3ce20 None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:27.443447 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-0fb16b56-b17a-418e-ae2c-5c8c7cf3ce20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:27.450906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1454/2895] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 17 23:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:27.463340 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:27.474126 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bbf170-216b-454b-865c-2c6a6faa0bfc service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:27.480059 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:27.480654 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:27.480942 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:27.481220 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:27.496814 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:27.498413 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:27.506617 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1442/2896] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:37:27.717978 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8da6-e815-40c6-9378-9abcfa6d7daf None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:27.718437 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8da6-e815-40c6-9378-9abcfa6d7daf None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:27.718555 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd8da6-e815-40c6-9378-9abcfa6d7daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:27.738304 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-17fd8da6-e815-40c6-9378-9abcfa6d7daf None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:27.739600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-17fd8da6-e815-40c6-9378-9abcfa6d7daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:27.747393 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1455/2897] 10.222.0.39 () {58 vars in 1009 bytes} [Wed Aug 17 23:37:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:27.759878 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:27.771007 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eb9dc-3477-4c5b-ac05-8922cc556c21 service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:27.776686 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:27.777279 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:27.777563 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:27.777853 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:27.785955 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:27.787564 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:27.795786 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1443/2898] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:37:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:37:28.118110 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:28.118604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:28.118920 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:28.139482 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:28.140675 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:28.147684 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1456/2899] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 17 23:37:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:28.160673 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:28.172161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a31f5-6bda-47e7-9466-edf14bf45b7c service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:28.177406 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c633128e-fca6-4883-b466-2844b9071985 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:28.178039 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633128e-fca6-4883-b466-2844b9071985 service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:28.178316 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633128e-fca6-4883-b466-2844b9071985 service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:28.178583 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c633128e-fca6-4883-b466-2844b9071985 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:28.186688 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633128e-fca6-4883-b466-2844b9071985 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:28.188281 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c633128e-fca6-4883-b466-2844b9071985 service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:28.196416 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1444/2900] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:37:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 17 23:37:30.260802 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:30.323441 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f28a0b-3c73-4e8e-b559-69dff9690c1c None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:30.327947 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:30.328575 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:30.328858 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:30.329134 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] PATH_INFO: `/v3/users/fa47724d4df6499f8a43e94a1f444bfc` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:30.330259 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa47724d4df6499f8a43e94a1f444bfc)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:30.332245 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:30.378006 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa47724d4df6499f8a43e94a1f444bfc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.378668 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa47724d4df6499f8a43e94a1f444bfc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.384416 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:30.395250 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa47724d4df6499f8a43e94a1f444bfc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.403341 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa47724d4df6499f8a43e94a1f444bfc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.410551 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa47724d4df6499f8a43e94a1f444bfc'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.420923 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1457/2901] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:37:30 2022] DELETE /identity/v3/users/fa47724d4df6499f8a43e94a1f444bfc => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:30.425402 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] REQUEST_METHOD: `POST` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:30.425874 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:30.425979 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:30.445103 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.auth.core [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] MFA Rules not processed for user `d38ffb577def40dfa87abed73eb72b3e`. Rule list: `[]` (Enabled: `True`). {{(pid=85576) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:37:30.446868 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:30.475031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=100 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:30.504909 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1445/2902] 10.222.0.39 () {58 vars in 958 bytes} [Wed Aug 17 23:37:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:37:30.514439 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:30.516035 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:30.573697 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869a2cb4-7e2e-4c76-a3bd-115f7fe51642 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:30.577335 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b2ddc26aee434b5d954cb42d979df7a2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:30.577932 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:30.578320 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:30.578600 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:30.588586 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:30.590014 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:30.599411 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1458/2903] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:30.771628 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:30.773090 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:30.785444 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d4677c-30b3-4dec-91b1-fa3d90576e4f None None] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:30.791825 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:30.792479 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:30.793065 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:30.793349 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] PATH_INFO: `/v3/projects/19d3db7daead4d56a6a47ccf7898d98f` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:30.794485 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d3db7daead4d56a6a47ccf7898d98f)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:30.797260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:30.847432 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d3db7daead4d56a6a47ccf7898d98f', 'request_id': 'req-2415c87f-990c-4752-9db2-41be2e39141e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.853505 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d3db7daead4d56a6a47ccf7898d98f', 'request_id': 'req-2415c87f-990c-4752-9db2-41be2e39141e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.861105 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d3db7daead4d56a6a47ccf7898d98f', 'request_id': 'req-2415c87f-990c-4752-9db2-41be2e39141e'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.872748 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] The token cache is being invalidate because project 19d3db7daead4d56a6a47ccf7898d98f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:37:30.873042 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.873732 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:37:30.875243 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1446/2904] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:37:30 2022] DELETE /identity/v3/projects/19d3db7daead4d56a6a47ccf7898d98f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:37:40.595265 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=36,keystone:DELETE=2,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:40.869805 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=39,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:37:52.654692 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:52.656286 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:52.751719 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b05b26-65ec-45a2-a344-023e8490c365 service neutron] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:52.831647 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:52.832499 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:52.832789 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:52.833190 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:52.835424 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:52.858594 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:52.862322 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a2859-a215-439f-9635-b23b11b346b0 service nova] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:52.882280 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1459/2905] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:37:59.194078 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:37:59.196043 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:59.214744 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2415c87f-990c-4752-9db2-41be2e39141e admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:37:59.222610 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8ba4d7dcfc6248118c0100c91a8e0236', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['member', 'service', 'ResellerAdmin', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:37:59.223292 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:37:59.223576 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:37:59.223851 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:37:59.225581 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:37:59.240945 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:37:59.243212 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:37:59.254345 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1447/2906] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:37:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:38:00.335941 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] REQUEST_METHOD: `POST` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:38:00.336450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:38:00.336554 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:38:00.355046 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.auth.core [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] MFA Rules not processed for user `256d6e0dec3d4855a539044716650173`. Rule list: `[]` (Enabled: `True`). {{(pid=85577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 17 23:38:00.356239 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:38:00.410979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1460/2907] 10.222.0.39 () {58 vars in 967 bytes} [Wed Aug 17 23:38:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 17 23:38:00.424359 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:38:00.426358 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:38:00.497031 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e4508e-6913-41ab-86a9-bd63eafd19ed service nova] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:38:00.501920 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '53bb1987763944d3935ee9479b8032f3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:38:00.502523 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] REQUEST_METHOD: `GET` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:38:00.502843 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:38:00.503122 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:38:00.511738 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:38:00.513311 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:38:00.521594 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1448/2908] 10.222.0.39 () {60 vars in 1384 bytes} [Wed Aug 17 23:38:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 17 23:38:07.193204 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:38:07.195364 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:38:07.228633 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=100 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:38:07.265205 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05640302-b0a2-4f7e-95bd-5ca65ae9dfbf None None] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:38:07.269632 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:38:07.270264 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:38:07.270544 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:38:07.270849 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] PATH_INFO: `/v3/users/064bcb7672ae4527a3b77980d3aac036` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:38:07.271979 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=064bcb7672ae4527a3b77980d3aac036)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:38:07.274815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:38:07.322293 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '064bcb7672ae4527a3b77980d3aac036'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.322901 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '064bcb7672ae4527a3b77980d3aac036'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.334514 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '064bcb7672ae4527a3b77980d3aac036'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.341908 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '064bcb7672ae4527a3b77980d3aac036'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.348727 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '064bcb7672ae4527a3b77980d3aac036'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.355085 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1461/2909] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:38:07 2022] DELETE /identity/v3/users/064bcb7672ae4527a3b77980d3aac036 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:38:07.526028 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:38:07.537210 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5631d0-3364-4c8d-afe2-df2c1fb2f4f1 service swift] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:38:07.608045 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:38:07.608632 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:38:07.608914 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:38:07.609185 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] PATH_INFO: `/v3/projects/f63cbb6abd7a4200bb0a72f92d4ee6a8` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:38:07.610300 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f63cbb6abd7a4200bb0a72f92d4ee6a8)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:38:07.612260 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:38:07.658504 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f63cbb6abd7a4200bb0a72f92d4ee6a8', 'request_id': 'req-8833d71b-623b-4429-b261-a0ea73e90b93'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.666426 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f63cbb6abd7a4200bb0a72f92d4ee6a8', 'request_id': 'req-8833d71b-623b-4429-b261-a0ea73e90b93'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.673840 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f63cbb6abd7a4200bb0a72f92d4ee6a8', 'request_id': 'req-8833d71b-623b-4429-b261-a0ea73e90b93'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.685172 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] The token cache is being invalidate because project f63cbb6abd7a4200bb0a72f92d4ee6a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:38:07.685461 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.686083 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.687588 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1449/2910] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:38:07 2022] DELETE /identity/v3/projects/f63cbb6abd7a4200bb0a72f92d4ee6a8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:38:07.691559 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:38:07.693023 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:38:07.706604 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc23d8e6-3d7b-4f77-8e9b-b626de886871 admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:38:07.763606 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:38:07.764252 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:38:07.764584 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:38:07.764857 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] PATH_INFO: `/v3/users/47fef6ee14e04802bdbd1b6ec1485822` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:38:07.766010 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=47fef6ee14e04802bdbd1b6ec1485822)` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:38:07.768351 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:38:07.813815 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47fef6ee14e04802bdbd1b6ec1485822'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.814460 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47fef6ee14e04802bdbd1b6ec1485822'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.816382 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:38:07.828659 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47fef6ee14e04802bdbd1b6ec1485822'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.835450 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47fef6ee14e04802bdbd1b6ec1485822'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.843007 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.notifications [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47fef6ee14e04802bdbd1b6ec1485822'} {{(pid=85577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:07.849170 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1462/2911] 10.222.0.39 () {58 vars in 1224 bytes} [Wed Aug 17 23:38:07 2022] DELETE /identity/v3/users/47fef6ee14e04802bdbd1b6ec1485822 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 17 23:38:08.026161 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Authenticating user token {{(pid=85576) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:38:08.027705 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.fernet_utils [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85576) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:38:08.041566 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8833d71b-623b-4429-b261-a0ea73e90b93 admin admin] Validating token access rules against request {{(pid=85576) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:38:08.045257 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:38:08.100950 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd38ffb577def40dfa87abed73eb72b3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f53e7d1f09604616930e1b6b4872ea9e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85576) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:38:08.101884 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:38:08.102195 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:38:08.102467 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] PATH_INFO: `/v3/projects/952d38a6393f48f29a65a65a90417515` {{(pid=85576) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:38:08.103616 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952d38a6393f48f29a65a65a90417515)` {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:38:08.105502 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] RBAC: Authorization granted {{(pid=85576) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:38:08.151648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952d38a6393f48f29a65a65a90417515', 'request_id': 'req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:08.157239 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952d38a6393f48f29a65a65a90417515', 'request_id': 'req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:08.164646 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952d38a6393f48f29a65a65a90417515', 'request_id': 'req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3'} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:08.175728 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] The token cache is being invalidate because project 952d38a6393f48f29a65a65a90417515 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=85576) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 17 23:38:08.176018 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:08.176648 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG keystone.notifications [None req-b77d79c1-9b4e-42dc-bccd-2756f48d8df3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=85576) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 17 23:38:08.178113 dv-cinder-820027-20-smb devstack@keystone.service[85576]: [pid: 85576|app: 0|req: 1450/2912] 10.222.0.39 () {58 vars in 1233 bytes} [Wed Aug 17 23:38:08 2022] DELETE /identity/v3/projects/952d38a6393f48f29a65a65a90417515 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 17 23:38:17.845552 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=11,keystone:DELETE=3,keystone:INSERT=1 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:38:18.172772 dv-cinder-820027-20-smb devstack@keystone.service[85576]: DEBUG dbcounter [-] [85576] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=85576) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 23:40:03.747025 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Authenticating user token {{(pid=85577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 17 23:40:03.748772 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:40:03.818498 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b3092-638e-4e80-9939-54eddd1639ea admin admin] Validating token access rules against request {{(pid=85577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 17 23:40:03.877013 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee2a386cf6c549c59051ee161f9a1d3c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aa5944918b1c42129bedec2198bb7391', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=85577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 17 23:40:03.877623 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] REQUEST_METHOD: `GET` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 17 23:40:03.877906 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] SCRIPT_NAME: `/identity` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 17 23:40:03.878181 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=85577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 17 23:40:03.879904 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.fernet_utils [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=85577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 17 23:40:03.891699 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 17 23:40:03.893273 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1698a8f-8236-401b-8867-9490cbffd2b1 service placement] RBAC: Authorization granted {{(pid=85577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 17 23:40:03.903614 dv-cinder-820027-20-smb devstack@keystone.service[85577]: [pid: 85577|app: 0|req: 1463/2913] 10.222.0.39 () {60 vars in 1365 bytes} [Wed Aug 17 23:40:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 17 23:40:13.898783 dv-cinder-820027-20-smb devstack@keystone.service[85577]: DEBUG dbcounter [-] [85577] Writing DB stats keystone:SELECT=58 {{(pid=85577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}